Home Lex Fridman Notes
Lex Fridman · 2022-09-21 · 2h 36m

Rana el Kaliouby: Emotion AI, Social Robots, and Self-Driving Cars | Lex Fridman Podcast #322

Emotion-AI pioneer Rana el Kaliouby on reading human feeling from faces, social robots, in-car sensing, and an empathy crisis.

Rana el Kaliouby: Emotion AI, Social Robots, and Self-Driving Cars | Lex Fridman Podcast #322
The guest

Rana el Kaliouby — Egyptian-American computer scientist who pioneered emotion-recognition AI. Founder of Affectiva (acquired by Smart Eye, where she is now deputy CEO) and author of the memoir Girl Decoded.

The gist

Rana el Kaliouby traces her path from a childhood in Egypt and Kuwait to a PhD at Cambridge and a postdoc at the MIT Media Lab under Rosalind Picard, and the founding of Affectiva. The conversation digs into the science and limits of detecting emotion from the human face, arguing context and multimodal signals matter far more than naive 'smile equals happy' mappings. They explore social robotics, the movie Her, and whether AI companions that can leave us are a feature or a bug. A large segment covers Smart Eye's automotive driver- and interior-sensing work, including drowsiness, distraction, and alcohol detection, and a vision of the car as a wellness center. It closes on startup and investing advice, diversity in AI funding, and reflections on planning, parenting, and love.

Big reveals

  • After 9/11 she briefly swapped her hijab for British hats at Cambridge before deciding to go back to the headscarf.
  • Describes taking off the hijab after 12 years amid divorce and political upheaval, calling it harder than putting it on.
  • A two-hour meeting with Rosalind Picard led to a postdoc offer that redirected her life and ended her plan to return to Egypt.
  • Her first NSF autism grant was rejected; Picard's reframe ('build it, show them, reapply') became a lasting lesson.
  • Lex narrates his own real-time anxiety about controlling his facial expressions during the interview.
  • The shutdown of the Jibo robot 'died' and traumatized her son, unlike any other broken gadget.
  • Reveals Smart Eye's CEO proposed acquiring Affectiva after roughly four months of near-daily FaceTime calls.
  • Cites Kenneth Stanley's 'Why Greatness Cannot Be Planned' to argue over-optimizing kills creativity.

Things worth remembering

  • Her parents met when her father taught a COBOL class her mother enrolled in, then proposed when she refused to date.
  • She commuted between Cairo and Boston every few weeks during her MIT postdoc.
  • Claims roughly 90% of how we communicate is nonverbal facial expression.
  • Affectiva found people still emote facial expressions even when alone watching Netflix or driving.
  • A female engineer flagged that Google's phone-unlock model assumed users keep phones in pockets, which women's clothing often lacks.
  • Smart Eye tech has been selected by 14 leading car manufacturers across 94 car models.
  • To gather data, they got people progressively drunk on a closed racetrack with a safety driver.
  • New Roomba models tout state-of-the-art 'poop detection' to avoid running over pet messes.
  • Her daily affirmation 'my smile lights up the whole world' leads strangers on the street to compliment her smile.
  • Notes only about 20 of roughly 400 attendees at an investing 'Capital Camp' were women.

Recommended in this episode

Books, products and media the guest or host genuinely endorsed here — with the buy link.

Affiliate link — we may earn a commission at no extra cost to you.

Guest’s ownBook

Girl Decoded

Rana el Kaliouby

“founder of effectiva Deputy CEO of Smart Eye author of girl decoded and one of the most brilliant kind inspiring” — Lex Fridman 00:00:30
Find it on Amazon
RecommendedProduct

Day One

Bloom Built (inferred)

“I've been doing journaling for almost 10 years now um I used an app called day one and it's awesome I just journal” — Rana el Kaliouby 00:42:49
Find it on Amazon
RecommendedMedia

Her

Spike Jonze (inferred)

“The thing I love them I love the movie Her by the way but the thing I love the most about this movie” — Rana el Kaliouby 01:24:31
Find it on Amazon
RecommendedMedia

Huberman Lab

Andrew Huberman

“he has an amazing podcast Andrew humor is a neuroscientists from Stanford a good friend of mine” — Lex Fridman 01:52:07
Find it on Amazon
RecommendedBook

Why Greatness Cannot Be Planned

Kenneth Stanley

“super inspiring talk Kenneth Stanley he was at open AI he just laughed and here's a book called why greatness can't be planned” — Lex Fridman 02:29:47
Find it on Amazon