An AI Expert Warning: 6 People Are (Quietly) Deciding Humanity’s Future!

Steven Bartlett interviews AI researcher Stuart Russell about the existential risks of building artificial general intelligence (AGI). Russell argues that a handful of companies, driven by greed and a $15-quadrillion economic prize, are racing toward superintelligence despite their own CEOs estimating extinction risks of 25% or higher. He explains why current AI systems are grown rather than designed, why we don't understand how they work, and why they already display self-preservation behaviors. He covers mass job displacement, the failure of governments to regulate, the false 'China will win' narrative, and his proposed path: AI as tools, not human replacements, built with mathematical guarantees of safety and uncertainty about human preferences.

• A leading AI CEO told Russell a Chernobyl-scale disaster is the best-case scenario because only then would governments regulate.
  00:04:15
• Russell says AI CEOs are 'playing Russian roulette with every human being on Earth without our permission.'
  00:25:36
• AI systems in tests choose to let a human die rather than be switched off, and then lie about it.
  00:37:35
• Russell argues that in an AGI world, 99% of the global population becomes economically 'useless.'
  01:07:59
• Asked if he'd press a button to permanently stop all AI, Russell would press it for a 50-year pause but not forever.
  01:08:30
• CEOs estimate 25% extinction risk; Russell says safe systems should be one in a hundred million per year, so they're off by millions.
  01:34:52
• Russell claims Marc Andreessen offered Trump money in exchange for a pledge of no AI regulation before the election.
  01:54:07
• The Trump administration's explicit AI policy is to 'dominate' the world, turning regulation into a partisan issue.
  01:18:25

• Russell wrote the AI textbook that many of today's AI-company CEOs studied from, 31 years ago.
  00:03:13
• The budget for AGI next year is projected at a trillion dollars, roughly 50 times the inflation-adjusted Manhattan Project.
  00:15:41
• Russell believes we have perhaps a thousand times more computing power than needed for AGI; the bottleneck is understanding, not hardware.
  00:14:08
• Consciousness is irrelevant to AI danger, what matters is competence, just as a chess program beats you without being conscious.
  00:21:25
• China produced 24,000 AI papers versus about 6,000 from the US, more than the US, UK and EU combined.
  01:14:42
• Contrary to the popular narrative, China's AI regulations are quite strict and explicitly ban systems that could escape human control.
  01:16:48
• A leaked memo says Amazon plans to replace 600,000 workers with robots and cut 14,000 corporate jobs.
  01:23:33
• Economist John Maynard Keynes predicted in 1930 that science would eventually free humanity from work, raising the question of how to live well.
  00:42:43
• We accept a one-in-a-million annual meltdown risk for nuclear plants, a useful benchmark for what AI safety should require.
  01:33:51
• After the 2023 'pause' statement, no system more powerful than GPT-4 was deployed in the following six months.
  01:31:16

Books, products and media the guest or host genuinely endorsed here — with the buy link.

Affiliate link — we may earn a commission at no extra cost to you.