• for: progress trap, AI, AI - care drive
• comment
  • the precautionary principle needs to be observed with AI because it has such vast artificial cognitive, pattern-recognition processes at its disposal
  • AI will also make mistakes, but the degree of power behind the mistaken decision, recommendation or action is the degree of unintended consequences or progress trap
  • An example nightmare scenario could be:
    • AI could decide that humans are contradicting their own goal of a stable climate system and if it's in control, may think it knows better and perform whole system change that dramatically reduces human induced climate change but actually harms a lot of humans in the process, for reaching the goal of saving the climate system plus a sufficient subset of humans to start all over.

• Title
  • One Billion Happy

• Author

  • Mo Gawdat

• Description

  • Mo Gawdat was former chief business officer at Google X, Google's innovation center.
  • Mo left Google after seeing the rapid pace of AI development was going to lead to a progress trap in which
    • the risk of AI destroying human civilization is becoming real because AI will be learning from too many unhappy people whose trauma AI will learn and incorporate into its algorithms
  • Hence, human happiness becomes paramount to prevent this catastrophe from happening
• See Ronald Wright's prescient quote
  • https://hyp.is/go?url=https%3A%2F%2Fwww.goodreads.com%2Fwork%2Fquotes%2F321797-a-short-history-of-progress&group=Q2X5j1pR

• Singularity
  • will happen within the next few decades

• It is the immoral human being that is the real problem
• they will teach AI to be immoral and with its power, can end up destroying humanity

• Title
  • Mo Gawdat Warns the Dangers of AI Are "Happening As We Speak"
• Author
  • Piers Morgan Uncensored

• "if we reverse this

  • if we have the best of us take charge
  • the best of us will tell AI
    • don't try to kill the the enemy,
      • try to reconcile with the enemy
    • don't try to create a competitive product
      • that allows me to lead with electric cars,
        • create something that helps all of us overcome global climate change
    • that's the interesting bit
      • the actual threat ahead of us is
        • not the machines at all
          • the machines are pure potential pure potential
        • the threat is how we're going to use them"

• comment

  • again, see Ronald Wright's quote above
  • it's very salient to this context

• comment
  • the machines are only coded to do what we tell them to do
  • Ronald' Wright's quote is very salient here
    • https://hyp.is/6Lb6Uv5NEe2ZerOrftOHfA/www.goodreads.com/work/quotes/321797-a-short-history-of-progress

• limited (machine) intelligence

  • cannot help but exist
  • if the original (human) authors of the AI code are themselves limited in their intelligence

• comment

  • this limitation is essentially what will result in AI progress traps
  • Indeed,
    • progress and their shadow artefacts,
    • progress traps,
    • is the proper framework to analyze the existential dilemma posed by AI

• Comment
  • Mary echos Ronald Wright's progress traps

Key finding Paraphrase - So what does a conscious universe have to do with AI and existential risk? - It all comes back to whether our primary orientation is around - quantity, or around - quality. - An understanding of reality - that recognises consciousness as fundamental - views the quality of your experience as - equal to, - or greater than, - what can be quantified.

• Orienting toward quality,
  • toward the experience of being alive,
• can radically change
  • how we build technology,
  • how we approach complex problems,
  • and how we treat one another.

Quote - metaphysics of quality - would open the door for ways of knowing made secondary by physicalism

Author - Robert Persig - Zen and the Art of Motorcycle Maintenance // - When we elevate the quality of each our experience - we elevate the life of each individual - and recognize each individual life as sacred - we each matter - The measurable is also the limited - whilst the immeasurable and directly felt is the infinite - Our finite world that all technology is built upon - is itself built on the raw material of the infinite

//

Title Reality Eats Culture For Breakfast: AI, Existential Risk and Ethical Tech Why calls for ethical technology are missing something crucial Author Alexander Beiner

Summary - Beiner unpacks the existential risk posed by AI - reflecting on recent calls by tech and AI thought leaders - to stop AI research and hold a moratorium.

• Beiner unpacks the risk from a philosophical perspective

  • that gets right to the deepest cultural assumptions that subsume modernity,
  • ideas that are deeply acculturated into the citizens of modernity.

• He argues convincingly that

  • the quandry we are in requires this level of re-assessment
    • of what it means to be human,
    • and that a change in our fundamental cultural story is needed to derisk AI.

= progress trap example

= Comment - this is worrying. - if the Chatbots perceive an enemy it to harm it, it could take haarmful actions against the perceived threat

= progress trap example - Bing ChatGPT - example of AI progress trap

• example of = AI progress trap
• Bing can be seen
  • insulting users,
  • lying to them,
  • sulking,
  • gaslighting
  • emotionally manipulating people,
  • questioning its own existence,
  • describing someone who found a way to force the bot to disclose its hidden rules as its “enemy,” and
  • claiming it spied on Microsoft’s own developers through the webcams on their laptops.