The AI Kubernetes Show
The AI Kubernetes Show
0
The AI Kubernetes Show explores the practical challenges of running AI workloads on Kubernetes platforms. Episodes dig into real-world adoption stories, covering architecture decisions, tooling and operational pitfalls. Typical topics include GPU scheduling, model serving, autoscaling and resource management. The show is aimed at platform engineers, DevOps teams and machine learning practitioners working in cloud-native environments.
Episodes
-
Is It Easier to Write a Vulnerability Than to Find One? 23.09.2026 38mStatic analysis tools used to be right about as often as a coin flip. Kathleen Goeschel, Principal Product Security Engineer at Red Hat, spent years using machine learning to fix that, and now she's watching large language models change both sides of the fight. How fast vulnerable code gets written, and how fast it gets found.Goeschel walks through how she trained machine learning models on aggregated scanner alerts, software metrics, and prior CVEs to cut false positives in static analysis, and the surprising finding that code churn alone predicted real vulnerabilities better than most of the... -
Durable Execution for AI Agents in Kubernetes 09.09.2026 44mIf your AI agent restarts and loses everything it was doing, your platform team is stuck retrofitting recovery logic Kubernetes was never built for. Mark Fussell, CEO of Diagrid and creator of the Dapr project, joins the AI Kubernetes Show to explain why that's the real infrastructure problem in the agentic AI era, not the model.Fussell built the platform running Azure SQL Server at scale during 20 years at Microsoft, then spent the last 9 years building Dapr (Distributed Application Runtime), now a CNCF-graduated project. He and host William Morgan cover durable execution and why he calls it... -
Matt Barker (BoltMCP) on SPIFFE, AI Agent Identity, and Kubernetes 26.08.2026 46mAI-generated code is 40% more likely to leak a secret. Matt Barker, co-founder of the company that built cert-manager and later led secure workload access at CyberArk, explains why SPIFFE might finally fix workload identity for AI agents.Matt and William Morgan cover why SPIFFE replaces long-lived secrets with short-lived, cryptographic workload identities, what Matt is building at BoltMCP to control what an AI agent can see and do once it's trusted, and why CISOs are being told to enable AI adoption "at all costs."Topics covered:Why SPIFFE replaces secrets with short-lived workload identities... -
Disaggregated Inference on Kubernetes 12.08.2026 56mEvery LLM inference request splits into two phases with completely different hardware profiles: pre-fill and decode. But most Kubernetes clusters still run them on the same pod. Morgan Foster, who works on the llm-d project and the AI Gateway Working Group out of Red Hat's Office of the CTO, joins William Morgan to explain what that means. Foster and Morgan get into why real-time inference workloads fit the primitives Kubernetes already has, while training often runs on Slurm instead. They walk through disaggregated inference: how pre-fill and decode get scheduled on separate pods, how KV cach... -
The State of Cloud Native AI and What’s Still Evolving 29.07.2026 48mThere is no agreed upon definition of what cloud native AI means yet, but if you're trying to figure out where Kubernetes AI standards are really headed, check out this episode with someone who's worked on the CNCF's first attempt to define cloud native AI. William Morgan talks with Ron Petty (RXM, CNCF founding contributor, and member of the CNCF's TCG AI) about what's actually settled in cloud native AI and what isn't. They cover the CNCF's shift from working groups to technical community groups (TCGs), Petty's own framing of cloud native AI as a two-way street between building models and us... -
Treat Testing as a Platform Service on Kubernetes 15.07.2026 48mMost testing tools bolt onto a CI pipeline and hope for the best. Ole Lensmar, CTO of Testkube, built a company that changes that script. Pull test execution out of CI/CD entirely and run tests as Kubernetes workloads instead.In this episode, Lensmar walks through why Testkube uses Kubernetes as its test execution engine, running Selenium, Playwright, K6, JMeter, and Postman tests as cluster workloads instead of asking teams to adopt new tools. He and podcast host William Morgan dig into who should own testing (developers own functional tests, while the platform team owns performance, security... -
LLM Inference on Kubernetes: New Primitives, Real Challenges 01.07.2026 43mRunning LLM inference on Kubernetes requires new primitives for routing, autoscaling, and GPU scheduling. Here's what platform engineers need to know. -
Running Multi-agent AI on Kubernetes: Lessons from Imagine Learning 17.06.2026 48mIn this episode of The AI Kubernetes Show, Blake Romano, Staff Software Engineer at Imagine Learning, walks through what it actually looks like to build and run AI agents on Kubernetes at scale. He talks about the architecture choices, the failures, and why the organizational context you bring to the LLM matters more than which Software Development Kit (SDK) you use.Imagine Learning is a K-12 education company building digital platforms for students and educators, and Blake has been driving AI and platform engineering initiatives there. -
AI Agents Security: Guardrails & Production on Kubernetes 03.06.2026 41mLearn platform-level security patterns for AI agents on Kubernetes. Close the production gap with LLM guardrails, tool filtering, and short-lived tokens. -
Platform Engineering & Kubernetes: Guardrails For AI Code 20.05.2026 53mLearn how Schonfeld scaled their internal AI platform, SchonAI, using Kubernetes and established guardrails to manage AI agent code volume. Build your AI-native workflow now. -
One Dependency Away: Supply Chain Security in the Age of AI 06.05.2026 50mSecure your Kubernetes environment. Learn why zero trust cybersecurity is the only defense against AI agents and non-deterministic agentic software in your supply chain. -
Moving from Single Agents to AI Agent Fleets 14.01.2026 27mThe future of software development isn't about single agents—it's about building AI agent fleets! Dive into this conversation with Okteto CEO Ramiro Berrelleza to understand how this shift is fundamentally changing platform engineering and accelerating developer productivity. In this episode of The AI Kubernetes Show, we sat down with Ramiro to discuss AI adoption and the need for constant experimentation in the current "Cambrian explosion" of AI tooling. Berrelleza highlights the move from single-threaded AI tools to large, asynchronous AI agent fleets, which solves the bottleneck of waiting... -
Why Testing and Validation are the Unsolved AI Code Challenges 14.01.2026 27mIs your engineering org ready for the speed of AI? Grant Miller, CEO of Replicated, breaks down the intersection of AI and platform engineering, revealing why testing and validation are the biggest unsolved problems in the industry.In this episode of The AI Kubernetes Show, we sit down with Replicated CEO Grant Miller to discuss how the pace of AI is fundamentally reshaping software development. Miller argues that engineering velocity has become the core competitive differentiator and shares the concept of "leadership empathy," where leaders contribute to a pull request with AI to understand t... -
AI: Bubble or Bug? A CTO’s Perspective on Engineering in the AI Era 14.01.2026 27mIs the AI boom a bubble, or is it a new technological wave? Dinesh Majrekar, CTO of Civo, breaks down the current state of software development, explains why data sovereignty is the paramount security concern, and details how AI's real value lies in increasing code auality, not just velocity.In this episode of The AI Kubernetes Show, Civo CTO Dinesh Majrekar tackles the AI bubble hype, suggesting it is a blend of market speculation and genuine, disruptive innovation, drawing a comparison to the historical hardware monopoly of IBM during the mainframe era. He dives into the challenge of data so... -
Maintaining DevOps Integrity in the Age of AI Velocity 07.01.2026 27mIs AI velocity breaking your DevOps processes? We sat down with Principal Platform Engineer Ahmed Bebars to discuss the critical balance of using AI to ship code faster while maintaining DevOps integrity in your platform engineering team.Ahmed Bebars, a principal platform engineer and CNCF ambassador, breaks down the AI's impact on SDLC and the transformation of platform engineering. In this The AI Kubernetes Show episode, he argues that AI is a powerful productivity tool that increases velocity, but teams must uphold established DevOps processes, including rigorous integration and regression... -
AI's Double-Edged Sword: The Technical Imperative and the Path to Accessibility 07.01.2026 19mDiscover the dual nature of AI! Tech Lead Chris Khanoyan shares his view on the rapidly changing AI and data science landscape and the critical need for a technical foundation and the transformative power of AI accessibility for the deaf community. In this episode of The AI Kubernetes Show, we dive deep into the world of AI and data science with Chris Khanoyan, a tech lead and senior data scientist at Booz Allen. Chris highlights the rapidly changing data science landscape, noting the significant overlap between data scientists and data engineers. While auto-generated code has made coding more... -
The AI Tug-of-War: Bridging the Divide Between Platform Engineering and Data Science 07.01.2026 25mKeith Maddox, co-lead of the Kubernetes AI Working Group, breaks down the architectural shifts and security challenges required to run enterprise AI agents at scale.In this The Kubernetes AI Show episode, we chat with Keith Maddox, senior principal software engineer lead at Microsoft and Istio maintainer, who shares his perspective on the convergence of data science, AI agents, and platform engineering on Kubernetes AI workflows. He details the organizational dissonance between traditional platform stacks and data science workflows and how the Kubernetes AI working group is working to create a... -
Platform Engineering, AI, and the Two Faces of Cloud Native Sustainability 30.12.2025 11mKubeCon 2025 proved that platform engineering is essential, but the next big challenge for the cloud native community is sustainability. Learn from KubeCon Co-Chair Faseela what this future looks like and what it means for your platform.In this episode of The AI Kubernetes Show, we break down the key KubeCon NA 2025 takeaways with co-chair Faseela, a cloud native developer at Ericsson. She discusses the immense success of the Atlanta event and highlights the convergence of AI and Kubernetes, noting that platform engineering and AI were the hottest tracks based on talk submissions. Looking ahea... -
Stop Bolting on Security: The Key to Reliable AI Agent Systems 30.12.2025 16mIs your AI infrastructure safe? Marina Moore, research scientist and co-chair of CNCF Tag Security, talks about her research on AI agent isolation and how to build robust platform engineering security. Build it securely from the start!In this must-watch episode of The AI Kubernetes Show, we sit down with security expert Marina Moore to discuss the paradigm shift in AI-driven systems security. Moore shares her latest research on Securing Autonomous AI Agents by applying a "decompose" approach, which breaks down complex tasks into smaller pieces of work and enforces a security boundary with gate... -
Agentic AI Security on Kubernetes: Understanding Payload Routing and Defense-in-Depth 24.12.2025 1hIs your Kubernetes cluster ready for the next generation of AI workloads? Join Buoyant Tech Evangelist Flynn and Red Hat's Shane Utt from the AI Gateway Working Group as they reveal the critical shift from header-based to payload-based Kubernetes Networking for Agentic AI.In this episode of The Kubernetes AI Show, we dive deep into the challenges of running AI workloads on cloud native infrastructure with AI Gateway leaders, Flynn and Shane. They discuss how the AI Gateway Working Group evolved from the Gateway API inference extension (GIE) to focus on the average Kubernetes user who is often...
Popular in
The podcast also appears in the podcast charts of these countries.