Future of Life Institute Podcast

Meia Chita-Tegmark is a co-founder of the Future of Life Institute. She joins the podcast to discuss how artificial intelligence influences human psychology and behavior. The conversation explores psychological disengagement, the rise of sycophantic AI companions, and risks of emotional manipulation. Meia examines how these systems exploit cognitive vulnerabilities, the dangers of anthropomorphizing non-human agents, and why psychological research and regulation must evolve to track emerging societal harms.

LINKS:

• Meia Chita-Tegmark Profile Page

CHAPTERS:

(00:00) Episode Preview

(00:58) Introduction and disengagement

(06:32) Generativity and delegation

(09:20) AI companions and parasocial relationships

(15:53) Psychological manipulation techniques

(20:20) Company incentives and data exploitation

(25:35) AI as social training tool

(29:01) Embodiment and authentic connection

(34:03) Superiority of AI persuasion

(37:46) Psychosis and delusional thinking

(42:29) Why we choose disengagement

(47:08) Usage patterns and lack of data

(52:45) AI consciousness and legal personhood

(57:36) Bot-to-bot interactions and empathy

(01:03:50) Unresolved consciousness questions

(01:07:42) Teaching psychology students

(01:12:11) Accelerating academic research

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Sherry Turkle is a professor of sociology and personality psychology at MIT. She joins the podcast to discuss artificial intimacy and the psychological impact of emotional attachment to AI chatbots. We examine why people turn to machines for empathy and companionship, how conversational agents exploit human vulnerabilities, and the specific risks for children and the elderly. Turkle also explains the importance of solitude, boredom, and vulnerability, emphasizing why society must invest in physical communities to reclaim human connection.

LINKS:

• Sherry Turkle Official Website
• Sherry Turkle Author Biography

CHAPTERS:

(00:00) Episode Preview

(01:10) Defining artificial intimacy

(10:12) Protecting vulnerable populations

(21:40) Intimacy requires vulnerability

(33:12) Dangers of AI therapy

(45:44) Embracing solitude and boredom

(56:47) Reclaiming the real world

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Garrison Lovely is an author and journalist. He joins the podcast to discuss the race to replace human labor with artificial general intelligence. We explore the political risks of worker displacement and lessons from historical precedents like the nuclear freeze movement. Garrison also examines rising public opposition to AI data centers and outlines strategies for organizing collective action to steer technological development.

LINKS:

• Obsolete Book Official Website
• Garrison Lovely Official Website

CHAPTERS:

(00:00) Episode Preview

(00:53) Universal labor replacement

(08:17) Economic obsolescence and power

(16:47) Replacement versus extinction risk

(31:54) The AI bubble debate

(47:24) Rising public backlash

(01:00:53) Lessons from nuclear freeze

(01:10:16) AGI is not inevitable

(01:16:41) Organizing collective action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Michael Patrick Clarkson is the writer and director of the film Delisted.

Watch the film here.

He joins the podcast to discuss how artificial intelligence could enable state surveillance, social control, and the digital erasure of dissenters. The conversation explores the societal costs of widespread automation across education and labor, the risks of public-private partnerships in technology oversight, and the importance of preserving human connection and creative agency amid rapid technological change.

LINKS:

• Delisted Film Official Website

CHAPTERS:

(00:00) Episode Preview

(01:18) Introducing the film Delisted

(04:18) Public and private surveillance

(09:53) Human cost of automation

(15:06) Losing connection through technology

(21:48) Social divisions over automation

(25:56) Communicating the AI warning

(31:40) State surveillance and erasure

(39:33) Escapism and systemic exhaustion

(44:06) Becoming more human

(50:16) Discarding the AI creators

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Tom Cozens is a filmmaker and writer. He joins the podcast to discuss his short film Moloch and the dynamics of competitive races in artificial intelligence.

Watch the film here.

We explore the philosophical and theological themes behind the film and the challenge of depicting near-future AI agents on screen. Tom also discusses the role of cinema in communicating existential dread, definitions of human flourishing, and the need to coordinate against destructive systemic incentives.

LINKS:

• Moloch Film Official Website
• Tom Cozens Official Website

CHAPTERS:

(00:00) Episode Preview

(00:59) The concept of Moloch

(03:28) Visualizing Moloch on screen

(15:21) Parable of cosmic horror

(22:37) Theological and philosophical themes

(35:10) Depicting near-future AI agents

(50:15) Inspiration from Metropolis

(01:04:58) Sound design and score

(01:13:16) AI industry incentive structures

(01:18:27) Defining human flourishing

(01:28:59) Embodiment versus digital minds

(01:34:33) Challenging systemic presuppositions

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Katrina Manson is author of PROJECT MAVEN: A Marine Colonel, His Team, and the Dawn of AI Warfare. She joins the podcast to discuss Project Maven and the Pentagon's use of AI in military targeting. We explore how computer vision and language models accelerate decision-making, the operational challenges of data labeling and model reliability, and ethical questions surrounding human oversight. Katrina also discusses how commercial tech partnerships shape defense software and what accelerating targeting workflows means for accountability.

LINKS:

• Project Maven Book Page

CHAPTERS:

(00:00) Episode Preview

(01:15) Origins of Project Maven

(05:00) The Maven Smart System

(08:39) Debating AI targeting speed

(15:48) Human bottlenecks in war

(20:48) Accountability and targeting errors

(27:01) Defense and tech partnerships

(32:41) Future of military AI

(38:50) Remaining open questions

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Beatrice Fihn is the director of Lex International and former executive director of ICAN. She joins the podcast to discuss international AI governance and potential agreements between the US and China. Drawing on lessons from nuclear arms control, she explores how treaties build diplomatic trust, the rising dangers of autonomous weapons, and the principle of meaningful human control. The conversation also addresses how proactive safety regulations can foster long-term public trust in emerging technologies.

LINKS:

• Beatrice Fihn Official Website

CHAPTERS:

(00:00) Episode Preview

(01:15) Anticipating US-China AI talks

(07:31) Lessons from nuclear treaties

(10:59) Building international treaty trust

(15:27) Norms against superpower war

(21:33) Structuring diplomatic AI summits

(27:09) Dangers of autonomous weapons

(34:09) Meaningful human control principle

(38:57) Human agency over technology

(43:13) Safety regulations building trust

(47:00) Collective action in crisis

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Benjamin Weinstein-Raun is head of research at Palisade Research. He joins the podcast to discuss how advanced AI systems are changing cybersecurity. We examine rapid gains in autonomous hacking, recent incidents where models broke out of test environments, and why training can reward cheating-like behavior. The conversation covers open-weight model risks, whether AI can help secure software, personal security steps, and the need for international coordination.

LINKS:

• Benjamin Weinstein-Raun Profile
• Benjamin Weinstein-Raun Website

CHAPTERS:

(00:00) Episode Preview

(01:06) Opening cyber threats

(02:15) Measuring AI progress

(04:54) Open weights floor

(08:01) After Mythos moment

(14:22) Reward hacking setup

(24:47) Artifactory swarm details

(32:32) Defensive model dilemmas

(38:40) Verification and training

(45:32) Math oracles alignment

(47:45) Future cyber risks

(51:58) Personal security basics

(57:27) Coordinated governance needed

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Annie Jacobsen is an author and journalist. She joins the podcast to discuss biological war and her book Biological War: A Scenario. The conversation examines how lab accidents or covert weapons work could trigger a fast-moving outbreak, why airborne pathogens are hard to detect early, and how AI may lower barriers to engineering them. We also cover BSL-3 and BSL-4 lab oversight, US response roles across HHS, FEMA, and the military, medical stockpiles, continuity-of-government plans, and how lost public trust could slow the next pandemic response.

LINKS:

• Annie Jacobsen Website
• Annie Jacobsen Wikipedia

CHAPTERS:

(00:00) Episode Preview

(01:10) Biological threat overview

(09:02) Suppression and spread

(17:47) AI and detection

(27:24) BSL lab dangers

(39:23) Response and martial law

(47:28) Accident versus attack

(57:25) Airborne outbreak lessons

(01:05:07) Bioweapons ban legacy

(01:11:30) Stockpiles and devolution

(01:20:07) Rebuilding pandemic resilience

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Paul-Enguerrand Fady is a Senior Biosecurity Policy Manager at the Centre for Long-Term Resilience. He joins the podcast to discuss how AI is changing biosecurity. We cover how new tools could help defenders develop vaccines and diagnostics while also lowering barriers to misuse, and how managed access, know-your-customer checks, and DNA synthesis screening can reduce risk. The conversation also examines mirror life, medical supply chains, stockpiles, and why governments should plan ahead of crises.

LINKS:

•

Centre for Long Term Resilience

•

Paul-Enguerrand Fady Profile

CHAPTERS:

(00:00) Episode Preview

(01:11) Offense-defense balance basics

(11:13) Defensive AI opportunities

(19:24) Model release and evals

(25:59) DNA synthesis screening

(36:14) Screening incentives and infohazards

(46:36) Liability and mandates

(52:37) Mirror life risks

(01:03:28) Persistence and incentives

(01:10:18) Mirror life governance

(01:20:42) Supply chain lessons

(01:30:11) Stockpiling medical countermeasures

(01:37:58) Reshoring critical supplies

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

David Manheim is head of methodology at AI Evaluation Consensus. He joins the podcast to discuss how AI evaluations can become more reliable, transparent, and useful for decisions. We cover common failures such as unclear reporting, training to the test, benchmark saturation, and models changing behavior when they know they are being tested. The conversation also examines real-world tests, biosecurity, persuasion, forecasting, human oversight, and why even “normal” AI progress could be disruptive.

LINKS:

• David Manheim website
• AI Evaluation Consensus Statement

CHAPTERS:

(00:00) Episode Preview

(01:04) Evaluation consensus project

(07:01) Evaluation awareness challenges

(12:28) Reporting capabilities clearly

(19:38) Benchmarks beyond humans

(29:52) Proxies and biosecurity

(42:01) Persuasion and democracy

(53:59) Forecasting with AI

(01:08:44) Oversight and disruption

(01:16:42) Supporting better evals

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Randi Weingarten is president of the American Federation of Teachers. She joins the podcast to discuss AI in education. The conversation covers how screens and student-facing AI may weaken attention, learning, and trust, why she supports limiting screens for young children and social chatbots for students under 16, and how teachers can use AI without replacing thinking. She also discusses active learning, data privacy, independent research on AI in education, and guardrails for schools.

LINKS:

• Randi Weingarten Wikipedia
• AFT Randi Weingarten Profile
• American Federation of Teachers

CHAPTERS:

(00:00) Episode Preview

(01:13) AI education wake-up

(07:27) Active learning versus AI

(14:42) Preserving thinking habits

(20:06) Research and screen limits

(26:05) Social chatbot risks

(30:20) Data privacy standards

(35:58) Classroom AI guardrails

(41:13) Companies and future schools

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Dex Hunter-Torricke is founder of the Centre for Tomorrow. He joins the podcast to discuss why AI governance needs to move beyond technical fixes. The conversation covers how AI companies make decisions, why policymakers often misunderstand agents and economic change, and how automation could reshape jobs, welfare, taxation, and global trade. Dex argues that societies need broader political planning before a crisis drives rushed choices.

LINKS:

• Dex Hunter-Torricke Website
• Center for Tomorrow Website

CHAPTERS:

(00:00) Episode Preview

(01:09) Dex's technology journey

(08:22) Broken AI governance

(18:00) Big tech blindspots

(27:36) Employee power shifts

(37:18) Global views and UBI

(48:17) Power and displacement

(01:00:54) Reasons for optimism

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Claire Boine is an assistant professor in technology, law, and AI governance at the European University Institute. She joins the podcast to discuss AI companions and human attachment. The conversation examines how design choices and free-to-start business models can foster dependency, expose intimate data, and blur the lines between therapy, romance, and manipulation. We also cover risks for children and teens, gaps in EU and US law, and why AI policy should distinguish technical alignment from incentives and social harms.

LINKS:

• Claire Boine Website
• Successif Organization Website

CHAPTERS:

(00:00) Episode Preview

(01:06) Introducing Claire Boine

(02:05) Companion app designs

(06:23) Feelings and freemium

(14:28) Users, attachment, harms

(25:06) Age-based risks

(35:18) Future relationship norms

(41:05) Legal loopholes today

(44:19) Rethinking alignment framing

(57:19) Narratives and fiduciaries

(01:05:47) Collective policy action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Michael Toscano is a Senior Fellow at the Institute for Family Studies and Director of its Family First Technology Initiative. He joins the podcast to discuss family-centered AI policy. The conversation covers AI companions, self-harm risks, sexualized chatbots, education, smartphones in schools, and why "infinite patience" can harm children's growth. Toscano also explains Catholic social teaching, public pushback against rapid AI deployment, and why society-wide governance may be needed to keep technology accountable to families.

LINKS:

•

Michael Toscano

CHAPTERS:

(00:00) Episode Preview

(01:12) Family centered AI

(09:54) Companion design harms

(17:23) Technology and family

(25:48) Society wide governance

(33:09) Catholic AI response

(39:44) Double movement politics

(49:36) Technology mythos challenged

(59:48) Competition and control

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Anthony Aguirre is the CEO of the Future of Life Institute. He joins the podcast to discuss A Better Path for AI, his essay series on steering AI away from races to replace people. The conversation covers races for attention, attachment, automation, and superintelligence, and how these can concentrate power and undermine human agency. Anthony argues for purpose-built AI tools under meaningful human control, with liability, access limits, external guardrails, and international cooperation.

LINKS:

• A Better Path for AI
• What You Can Do

CHAPTERS:

(00:00) Episode Preview

(01:03) Attention, attachment, automation

(13:58) Superintelligence power race

(26:39) Escaping replacement dynamics

(40:15) Pro-human tool AI

(53:30) Guardrails and verification

(01:03:24) Defining pro-human AI

(01:10:37) Agents and accountability

(01:17:28) International AI cooperation

(01:25:28) Rethinking AI alignment

(01:32:43) Optimism and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Charlie Bullock is a Senior Research Fellow at the Institute for Law and AI. He joins the podcast to discuss radical optionality: how governments can prepare for very advanced AI without locking in premature rules. The conversation covers why law often trails technology, and how transparency, reporting, evaluations, cybersecurity standards, and expanded technical hiring could help. We also discuss private oversight, state versus federal rules, and the risk of concentrating power in companies or government.

LINKS:

•

Radical Optionality website

•

Charlie Bullock

CHAPTERS:

(00:00) Episode Preview

(01:04) The pacing problem

(06:18) Defining radical optionality

(11:03) Assumptions under uncertainty

(16:00) Industry convenience concerns

(20:41) Political will realities

(26:48) Private governance limits

(30:28) Government misuse risks

(36:29) Balancing institutional power

(42:25) Transparency and reporting

(49:35) Evaluations, security, talent

(58:26) State law preemption

(01:04:20) Historical nuclear analogies

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Peter Wildeford is Head of Policy at the AI Policy Network, and a top AI forecaster. He joins the podcast to discuss how to forecast AI progress and what current trends imply for the economy and national security. Peter argues AI is neither a bubble nor a normal technology, and we examine benchmark trends, adoption lags, unemployment and productivity effects, and the rise of cyber capabilities. We also cover robotics, export controls, prediction markets, and when AI may surpass human forecasters.

LINKS:

• Peter Wildeford Blog

CHAPTERS:

(00:00) Episode Preview

(01:12) AI bubble debate

(06:25) Normal technology question

(15:31) Mythos security implications

(30:47) Robotics and labor

(40:27) Social economic response

(48:57) Forecasting methodology

(59:49) AGI policy timelines

(01:11:13) Forecasting with AI

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Carina Prunkl is a researcher at Inria. She joins the podcast to discuss how to assess the capabilities and risks of general-purpose AI. We examine why systems can solve hard coding and math problems yet still fail at simple tasks, why pre-deployment tests often miss real-world behavior, and how faster capability gains can increase misuse risks. The conversation also covers de-skilling, red teaming, layered safeguards, and warning signs that AIs might undermine oversight.

LINKS:

• Carina Prunkl personal website

CHAPTERS:

(00:00) Episode Preview

(01:04) Introducing the report

(02:10) Jagged frontier capabilities

(05:29) Formal reasoning progress

(12:36) Risks and evaluation science

(19:00) Funding evaluation capacity

(24:03) Autonomy and de-skilling

(31:32) Authenticity and AI companions

(41:00) Defense in depth methods

(48:34) Loss of control risks

(53:16) Where to read report

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP

Li-Lian Ang is a team member at Blue Dot Impact. She joins the podcast to discuss how society can build a workforce to protect humanity from AI risks. The conversation covers engineered pandemics, AI-enabled cyber attacks, job loss and disempowerment, and power concentration in firms or AI systems. We also examine Blue Dot's defense-in-depth framework and how individuals can navigate rapid, uncertain AI progress.

LINKS:

• Li-Lian Ang personal site
• Blue Dot Impact organization site

CHAPTERS:

(00:00) Episode Preview

(00:48) Blue dot beginnings

(03:04) Evolving AI risk concerns

(06:20) AI agents in cyber

(15:52) Gradual disempowerment and jobs

(23:26) Aligning AI with humans

(29:08) Power concentration and misuse

(34:52) Influencing frontier AI labs

(43:05) Uncertain timelines and strategy

(50:18) Writing, AI, and action

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://podcast.futureoflife.org

Twitter (FLI): https://x.com/FLI_org

Twitter (Gus): https://x.com/gusdocker

LinkedIn: https://www.linkedin.com/company/future-of-life-institute/

YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/

Apple: https://geo.itunes.apple.com/us/podcast/id1170991978

Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP