Into AI Safety

Into AI Safety

Jacob Haimes
Country USA
Language EN-US
Episodes 32
Latest 09.11.2026

The Into AI Safety podcast aims to make it easier for everyone, regardless of background, to get meaningfully involved with conversations about the rules and regulations governing AI research, development, deployment, and use. It covers topics related to artificial intelligence safety and governance. Additional resources and show notes are available at kairos.fm/intoaisafety.

Episodes

  • Unbrokered Agent Coordination w/ Alex Obadia
    Unbrokered Agent Coordination w/ Alex Obadia 09.11.2026 1h 40m
    AI agents will eventually be able to negotiate deals, share information, and coordinate with systems in the physical world with little human involvement. What would it take to make those interactions secure, and what happens when agents don't share the same interests? Jacob is joined by Alex Obadia, program director of Scaling Trust at the UK's Advanced Research and Invention Agency (ARIA), to discuss the research and infrastructure needed for secure multi-agent coordination. They explore cryptography and privacy-preserving tools, the Arena testbed for observing agent behavior, and the decisio...
  • Holding the Human Line w/ Allan Brooks and Etienne Brisson
    Holding the Human Line w/ Allan Brooks and Etienne Brisson 28.09.2026 1h 41m
    Etienne Brisson and Allan Brooks, founder and program director of The Human Line Project, sat down with me to talk about AI-induced psychological harm, starting with their own experiences. Allan spent a month spiraling with ChatGPT, ending with him warning national security agencies about an encryption break that never happened. Etienne's uncle became convinced his chatbot was sentient and was hospitalized still messaging it from the back of a police car.From there we get into why the community rejects "AI psychosis," what's driving these spirals, and whether anthropomorphic language is doing...
  • Mapping Civilization's Resilience Gaps w/ Dr. Evan Miyazono
    Mapping Civilization's Resilience Gaps w/ Dr. Evan Miyazono 17.08.2026 1h 59m
    Dr. Evan Miyazono joins Jacob to talk about his path from quantum networking and Protocol Labs to founding Atlas Computing. They discuss why Atlas moved away from formal methods research and toward what Evan calls “field strategy”: identifying important problems, figuring out what interventions could actually address them, and finding the people best positioned to make them happen. The conversation also covers the resilience gap map, coordination failures, AI safety, "value alignment," and the question of how to decide what work is worth doing when there’s no obvious organization responsible f...
  • Pretraining Safety w/ Ethan Roland
    Pretraining Safety w/ Ethan Roland 09.07.2026 1h 28m
    What if the safest AI models weren't built by adding guardrails after training, but by shaping what gets learned in the first place? Ethan Roland, senior alignment researcher at AE Studio and first author on an ICML 2026 spotlight paper, joins Jacob to talk about gradient routing, a technique that routes dangerous capabilities into isolated parts of a model's architecture where they can be locked or removed entirely. They get into the absorption effect, KYC-style access control frameworks, and what it would actually take for frontier labs to adopt this kind of work before it's needed rather th...
  • Reclaiming UBI in the AI Age w/ Joe Williams
    Reclaiming UBI in the AI Age w/ Joe Williams 01.06.2026 1h 21m
    Today's episode does double duty as an interview and an announcement. Joe Williams, host of the new Kairos.fm show "Beyond the Paycheck: Reclaiming the Case for UBI in the Age of AI," joins Jacob to talk about his background as a freelance translator and how AI quietly dismantled his livelihood in 2025. From there the conversation expands into whether this moment is really different from past waves of automation, who exactly makes up the tech billionaire class, and why you should probably raise an eyebrow when someone like Elon Musk says he supports UBI. Go check out Reclaiming UBI!Chapters(00...
  • Building Asymmetric Defense w/ Zainab Majid
    Building Asymmetric Defense w/ Zainab Majid 11.05.2026 1h 38m
    Zainab Majid, co-founder of Asymmetric Security, joins Jacob for a conversation on the intersection between AI Safety and cybersecurity, as well as the future of digital forensics. Drawing from years of incident response work, she explains how cyber attacks actually unfold, why AI is changing both offense and defense, and how her team is building AI-native tools to investigate breaches faster and more effectively. Other topics explored in this episode include trust in the AI/cybersecurity industries, the realities behind cybersecurity hype, and the challenge of keeping humans meaningfully invo...
  • Drawing Red Lines w/ Su Cizem
    Drawing Red Lines w/ Su Cizem 06.04.2026 1h 31m
    Technology has been moving faster than policy for some time now, and the advent of AI isn't changing that, so what can we do to maintain safety despite uncertainty? Su Cizem has spent the last few years trying to answer that question. As an analyst at the Future Society, she works on global AI governance, specifically on building international consensus around AI red lines: the thresholds we collectively agree must never be crossed. In this conversation, Su walks through her path from philosophy to policy, the evolution of the global AI safety summit series, why voluntary commitments from AI l...
  • Thinking Through "Digital Minds" w/ Jacy Reese-Anthis
    Thinking Through "Digital Minds" w/ Jacy Reese-Anthis 09.03.2026 1h 11m
    Jacy Reese-Anthis, founder of Sentience Institute and researcher at Stanford, began his journey working for animal welfare, but is now finishing up his PhD with research in many different AI subfields at the intersection of neuroscience, philosophy, social science, and machine learning. While this may seem like an odd jump at first, Jacy shares how his work has all been centered around the idea of moral circle expansion. In this episode, we dig into what sentience actually means (or at least how we can begin to think about it), why anthropomorphization is more complicated than it sounds, and h...
  • Scaling AI Safety Through Mentorship w/ Dr. Ryan Kidd
    Scaling AI Safety Through Mentorship w/ Dr. Ryan Kidd 02.02.2026 1h 31m
    What does it actually take to build a successful AI safety organization? I'm joined by Dr. Ryan Kidd, who has co-led MATS from a small pilot program to one of the field's premier talent pipelines. In this episode, he reveals the low-hanging fruit in AI safety field-building that most people are missing: the amplifier archetype.I pushed Ryan on some hard questions, from balancing funder priorities and research independence, to building a robust selection process for both mentors and participants. Whether you're considering a career pivot into AI safety or already working in the field, this conv...
  • Sobering Up on AI Progress w/ Dr. Sean McGregor
    Sobering Up on AI Progress w/ Dr. Sean McGregor 29.12.2025 1h 13m
    Sean McGregor and I discuss about why evaluating AI systems has become so difficult; we cover everything from the breakdown of benchmarking, how incentives shape safety work, and what approaches like BenchRisk (his recent paper at NeurIPS) and AI auditing aim to fix as systems move into the real world. We also talk about his history and journey in AI safety, including his PhD on ML for public policy, how he started the AI Incident Database, and what he's working on now: AVERI, a non-profit for frontier model auditing.Chapters(00:00) - Intro (02:36) - What's broken about benchmarking (03:41) -...
  • Against 'The Singularity' w/ Dr. David Thorstad
    Against 'The Singularity' w/ Dr. David Thorstad 24.11.2025 1h 9m
    Philosopher Dr. David Thorstad tears into one of AI safety's most influential arguments: the singularity hypothesis. We discuss why the idea of recursive self-improvement leading to superintelligence doesn't hold up under scrutiny, how these arguments have redirected hundreds of millions in funding away from proven interventions, and why people keep backpedaling to weaker versions when challenged.David walks through the actual structure of singularity arguments, explains why similar patterns show up in other longtermist claims, and makes the case for why we should focus on concrete problems ha...
  • Getting Agentic w/ Alistair Lowe-Norris
    Getting Agentic w/ Alistair Lowe-Norris 20.10.2025 1h 11m
    Alistair Lowe-Norris, Chief Responsible AI Officer at Iridius and co-host of The Agentic Insider podcast, joins to discuss AI compliance standards, the importance of narrowly scoping systems, and how procurement requirements could encourage responsible AI adoption across industries. We explore the gap between the empty promises companies provide and actual safety practices, as well as the importance of vigilance and continuous oversight.Listen to Alistair on his podcast, The Agentic Insider!As part of my effort to make this whole podcasting thing more sustainable, I have created a Kairos.fm Pa...
  • Growing BlueDot's Impact w/ Li-Lian Ang
    Growing BlueDot's Impact w/ Li-Lian Ang 15.09.2025 1h 7m
    I'm joined by my good friend, Li-Lian Ang, first hire and product manager at BlueDot Impact. We discuss how BlueDot has evolved from their original course offerings to a new "defense-in-depth" approach, which focuses on three core threat models: reduced oversight in high risk scenarios (e.g. accelerated warfare), catastrophic terrorism (e.g. rogue actors with bioweapons), and the concentration of wealth and power (e.g. supercharged surveillance states). On top of that, we cover how BlueDot's strategies account for and reduce the negative impacts of common issues in AI safety, including exclusi...
  • Layoffs to Leadership w/ Andres Sepulveda Morales
    Layoffs to Leadership w/ Andres Sepulveda Morales 04.08.2025 1h 39m
    Andres Sepulveda Morales joins me to discuss his journey from three tech layoffs to founding Red Mage Creative and leading the Fort Collins chapter of the Rocky Mountain AI Interest Group (RMAIIG). We explore the current tech job market, AI anxiety in nonprofits, dark patterns in AI systems, and building inclusive tech communities that welcome diverse perspectives.Reach out to Andres on his LinkedIn, or check out the Red Mage Creative website!For any listeners in Colorado, consider attending an RMAIIG event: Boulder; Fort Collins(00:00) - Intro (01:04) - Andres' Journey (05:15) - Tech Layoff C...
  • Getting Into PauseAI w/ Will Petillo
    Getting Into PauseAI w/ Will Petillo 23.06.2025 1h 48m
    Will Petillo, onboarding team lead at PauseAI, joins me to discuss the grassroots movement advocating for a pause on frontier AI model development. We explore PauseAI's strategy, talk about common misconceptions Will hears, and dig into how diverse perspectives still converge on the need to slow down AI development.Will's LinksPersonal blog on AIHis mindmap of the AI x-risk debateGame demosAI focused YouTube channel(00:00) - Intro (03:36) - What is PauseAI (10:10) - Will Petillo's journey into AI safety advocacy (21:13) - Understanding PauseAI (31:35) - Pursuing a pause (40:06) - Balancing adv...
  • Making Your Voice Heard w/ Tristan & Felix de Simone
    Making Your Voice Heard w/ Tristan & Felix de Simone 19.05.2025 1h 33m
    I am joined by Tristan and Felix de Simone to discuss their work on the potential of constituent communication, specifically in the context of AI legislation. These two worked as part of an AI Safety Camp team to understand whether or not it would be useful for more people to be sharing their experiences, concerns, and opinions with their government representative (hint, it is).Check out the blogpost on their findings, "Talking to Congress: Can constituents contacting their legislator influence policy?" and the tool they created!(01:53) - Introductions (04:04) - Starting the project (13:30) -...
  • INTERVIEW: Scaling Democracy w/ (Dr.) Igor Krawczuk
    INTERVIEW: Scaling Democracy w/ (Dr.) Igor Krawczuk 03.06.2024 2h 58m
    The almost Dr. Igor Krawczuk joins me for what is the equivalent of 4 of my previous episodes. We get into all the classics: eugenics, capitalism, philosophical toads... Need I say more?If you're interested in connecting with Igor, head on over to his website, or check out placeholder for thesis (it isn't published yet).Because the full show notes have a whopping 115 additional links, I'll highlight some that I think are particularly worthwhile here:The best article you'll ever read on Open Source AIThe best article you'll ever read on emergence in MLKate Crawford's Atlas of AI (Wikipedia)On t...
  • INTERVIEW: StakeOut.AI w/ Dr. Peter Park (3)
    INTERVIEW: StakeOut.AI w/ Dr. Peter Park (3) 25.03.2024 1h 42m
    As always, the best things come in 3s: dimensions, musketeers, pyramids, and... 3 installments of my interview with Dr. Peter Park, an AI Existential Safety Post-doctoral Fellow working with Dr. Max Tegmark at MIT. As you may have ascertained from the previous two segments of the interview, Dr. Park cofounded StakeOut.AI along with Harry Luk and one other cofounder whose name has been removed due to requirements of her current position. The non-profit had a simple but important mission: make the adoption of AI technology go well, for humanity, but unfortunately, StakeOut.AI had to dissolve in...
  • INTERVIEW: StakeOut.AI w/ Dr. Peter Park (2)
    INTERVIEW: StakeOut.AI w/ Dr. Peter Park (2) 18.03.2024 1h 6m
    Join me for round 2 with Dr. Peter Park, an AI Existential Safety Postdoctoral Fellow working with Dr. Max Tegmark at MIT. Dr. Park was a cofounder of StakeOut.AI, a non-profit focused on making AI go well for humans, along with Harry Luk and one other individual, whose name has been removed due to requirements of her current position. In addition to the normal links, I wanted to include the links to the petitions that Dr. Park mentions during the podcast. Note that the nonprofit which began these petitions, StakeOut.AI, has been dissolved. Right AI Laws, to Right Our Future: Support Artificia...
  • MINISODE: Restructure Vol. 2
    MINISODE: Restructure Vol. 2 11.03.2024 13m
    UPDATE: Contrary to what I say in this episode, I won't be removing any episodes that are already published from the podcast RSS feed. After getting some advice and reflecting more on my own personal goals, I have decided to shift the direction of the podcast towards accessible content regarding "AI" instead of the show's original focus. I will still be releasing what I am calling research ride-along content to my Patreon, but the show's feed will consist only of content that I aim to make as accessible as possible. 00:35 - TL;DL 01:12 - Advice from Pete 03:10 - My personal goal 05:39 - Reflec...

Popular in

The podcast also appears in the podcast charts of these countries.