• for: quote - Yuval Noah Harari - AI progress trap, progress trap - AI, quote - progress trap

• quote it is extremely dangerous to create such an autonomous agent when we do not know how to control it, when we can't ensure that it will not escape our control ad start making decisions and creating new things which will harm us instead of benefit us

• author: Yuval Noah Harari
• date 2023

• for: quote - Thomas Homer-Dixon, quote - danger of AI, AI progress trap

• quote: danger of AI

  • I think the most dangerous thing about AI is not super smart AI, it's stupid AI that is good enough to be put in charge of certain processes but not good enough to not make really bad mistakes
• author: Thomas Homer-Dixon
• date: 2021

• for: quote, quote - Michael Levin, quote - self as control agent, self - control agent, example, example - control agent - imperfection, spontaneous thought, spontaneous action, creativity - spontaneity

• quote: Michael Levin

  • the Bodhisattva vow can be seen as a method for control that is in alignment with, and informed by, the understanding that singular and enduring control agents do not actually exist.

• comment

  • adjacency between
    • nondual awareness
    • self-construct
    • self is illusion
    • singular, solid, enduring control agent
  • adjacency statement
    • nondual awareness is the deep insight that there is no solid, singular, enduring control agent.
    • creativity is unpredictable and spontaneous and would not be possible if there were perfect control
• example - control agent - imperfection: start - the unpredictability of the realtime emergence of our next exact thought or action is a good example of this

• example - control agent - imperfection: end

• triggered insight: not only are thoughts and actions random, but dreams as well

  • I dreamt the night after this about something related to this paper (cannot remember what it is now!)
  • Obviously, I had no clue the idea in this paper would end up exactly as it did in next night's dream!

• quote
  • 2029 - AI will surpass human intelligence
  • 2049 - AI will be one billion X more intelligent than us

• "if we reverse this

  • if we have the best of us take charge
  • the best of us will tell AI
    • don't try to kill the the enemy,
      • try to reconcile with the enemy
    • don't try to create a competitive product
      • that allows me to lead with electric cars,
        • create something that helps all of us overcome global climate change
    • that's the interesting bit
      • the actual threat ahead of us is
        • not the machines at all
          • the machines are pure potential pure potential
        • the threat is how we're going to use them"

• comment

  • again, see Ronald Wright's quote above
  • it's very salient to this context

• comment
  • the machines are only coded to do what we tell them to do
  • Ronald' Wright's quote is very salient here
    • https://hyp.is/6Lb6Uv5NEe2ZerOrftOHfA/www.goodreads.com/work/quotes/321797-a-short-history-of-progress

• quote
  • "If we give up on human connection, we give up on the remainder of humanity"

• quote
  • "with great power comes great responsibility. We have disconnected power and responsibility."
    • "With great power comes great responsibility
    • We have disconnected power and responsibility
    • so today a 15 year old,
      • emotional without a fully developed prefrontal cortex to make the right decisions yet this is science and we developed our prefrontal cortex fully
      • and at age 25 or so with all of that limbic system emotion and passion
      • would buy a crispr kit and modify a rabbit to become a little more muscular and
      • let it loose in the wild
    • or an influencer who doesn't really know how far the impact of what they're posting online
      • can hurt and cause depression or
      • cause people to feel bad by putting that online
  • There is a disconnect between the power and the responsibility and
  • the problem we have today is that
    • there is a disconnect between those who are writing the code of AI and
    • the responsibility of what's going about to happen because of that code and
    • I feel compassion for the rest of the world
    • I feel that this is wrong
    • I feel that for someone's life to be affected by the actions of others
      • without having a say "

• quote
  • "what went wrong in the 20th century is that we have given too much power to people that didn't assume the responsbility"

• quote
  • "this is an arms race"

Quote - AI Gedanken - AI risk - The Paperclip Maximizer

Still an incredible headline...