Home Diary of a CEO Notes
Diary of a CEO · 2025-06-16 · 1h 30m

Godfather of AI: They Keep Silencing Me But I’m Trying to Warn Them!

AI pioneer Geoffrey Hinton lays out why superintelligence could end humanity, why he left Google to warn us, and why you should train as a plumber.

Godfather of AI: They Keep Silencing Me But I’m Trying to Warn Them!
The guest

Geoffrey Hinton — Nobel Prize-winning computer scientist known as the 'Godfather of AI' for pioneering neural networks over 50 years. He worked at Google for a decade before leaving in 2023 to speak freely about AI's existential risks.

The gist

Geoffrey Hinton explains how his lifelong bet on modeling AI on the brain became the foundation of modern AI, then turns to the dangers he now spends his time warning about. He separates risks from human misuse of AI (cyberattacks, AI-designed viruses, election manipulation, echo chambers, autonomous weapons, mass joblessness) from the longer-term existential risk of a superintelligence that no longer needs humans. He argues digital intelligences are fundamentally superior to biological ones because they can clone themselves and share knowledge billions of times faster, and that they likely already have rudimentary understanding, emotions, and consciousness. He calls for heavily regulated capitalism and governments forcing companies to fund safety research, while admitting he is genuinely agnostic about whether humanity will survive.

Big reveals

  • Hinton puts the odds AI wipes out humanity at 10 to 20 percent, calling it a gut estimate.
  • Reveals he spread his and his children's savings across three Canadian banks out of fear a cyberattack could take one down.
  • Recounts a billionaire friend telling him a top AI CEO privately doesn't care about the harm AI will cause, despite public safety talk.
  • Says he hasn't come to terms emotionally with what superintelligence could do to his children's future.
  • Claims current multimodal chatbots already have subjective experiences, a view he admits very few people share.
  • His closest thing to a eureka moment was Google's PaLM explaining why a joke is funny.
  • Discusses his extraordinary family tree, including ancestor George Boole and a cousin who worked on the Manhattan Project.
  • When asked what he'd tell his kids if they had no money, he answers simply: train to be a plumber.

Things worth remembering

  • Hinton notes new US AI models often can't launch in Europe immediately due to regulations.
  • Cyberattacks rose roughly 1,200 percent between 2023 and 2024, partly due to AI-powered phishing.
  • He argues a superintelligence wanting to remove humans would likely engineer a contagious, lethal, slow-acting virus.
  • His niece cut complaint-letter time from 25 minutes to 5 using a chatbot, meaning five times fewer workers needed.
  • Digital AIs can share knowledge by averaging a trillion weights, transferring trillions of bits per second versus humans' ~10 bits.
  • Because connection strengths can be stored and reloaded onto new hardware, Hinton says digital intelligence is effectively immortal.
  • GPT-4 explained how a compost heap is like an atom bomb, both being chain reactions at different time and energy scales.
  • Hinton sold his startup to Google at 65 to secure money for his son with learning difficulties.
  • He wrote an Atlantic article noting university graduates are already finding it harder to get jobs because of AI.
  • An anonymous CEO told him AI agents would shrink his workforce from over 7,000 to 3,000, handling 80 percent of customer service.