MLOps.community
Demetrios
0
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)
Episodes
-
He Used 100 Billion Tokens in a Month - Waymo Talks 19.11.2026 41mWhat happens when your AI coding agent gets better at finding bugs - but never knows when to stop?Jesse Vincent, creator of Superpowers and founder of Prime Radiant, joins us to explore what it actually takes to get useful work out of AI agents.We start with a tiny Playdate game console turned into a voice-controlled client for his coding agent. Then we dig into why agents ignore skills, what goes wrong when code review becomes an endless loop, and Jesse’s experience using 100 billion tokens in a month - including turning 30 years of email into a searchable personal knowledge base.Jesse also w... -
Multi-Cloud LLM Routing and Context-Aware Coding Agents 16.11.2026 29mIn this episode, we sit down with Matt Carey and Scott Crooks, engineers at Cloudflare and Miro, to look at how two very different companies are building their own AI software factories, and what happens to engineering when the code mostly writes and reviews itself.We start with the AI gateway: why a model call is no longer simple when the same model is served across multiple regions, multiple clouds, and direct from the provider, and how Miro pools rate limits and data residency rules (like EU-only models for German customers) into a single routing layer that also powers Miro’s Sidekicks. Mat... -
Why Stripe Cut 500,000 Internal Docs Down to 5,000? 13.11.2026 32mWhat happens when AI agents start relying on the same messy docs your team already struggles to search?Demetrios hops into a Waymo in San Francisco with Dave Nunez, founder and CEO of Falconer and co-author of Documentation for Developers. They talk about why developers and agents need different things from docs, why agents sometimes skip up-to-date instructions, and how a stale internal document can contribute to a production incident.Dave shares how Stripe cut roughly 500,000 internal docs down to 5,000 worth maintaining. The conversation also covers how to capture the reasoning behind engin... -
My AI Agent Bought Me A Car 09.11.2026 35mSam Herring’s first real test of Hermes Agent was a shopping tool that matched clothes to photos of ancient pottery. A few months later, the same agent was checking government auction sites every day until it found him a retired three-wheel parking ticket car, which he now drives around San Francisco. In this episode, recorded at AGNTCon + MCPCon North America in San Jose, Sam, who works on the RL post-training team at Nous Research, goes from those everyday wins to the question everyone in AI is asking: can agents improve themselves?He explains how Hermes grew from an internal productivity to... -
Cut One AI Cost and Two More Grow Back 05.11.2026 41mWhat does AI really cost once thousands of people inside a company start using it? Ioannis Zempekakis, Director of AI at Prosus, has been running agents in production since 2024. We put that question to him on a tandem bike ride from a favorite Amsterdam cafe to Vondelpark.Ioannis explains the decision to stop relying purely on cloud APIs, and why that approach breaks down at the scale of a large company. He covers why agent harnesses and sandboxes are as greedy as software gets, and why agents scheduled to run every five minutes repeat a lesson the data world already learned about freshness.... -
How Stanford Teaches AI Coding Now 02.11.2026 43mWhat does it take to build AI agents that deliver useful, reliable work?Stanford lecturer and Monaco Head of AI Mihail Eric joins Demetrios for a conversation inside a Waymo about how AI is changing software development - and what it takes to put agents into production.Mihail explains why he rebuilt most of his Modern Software Developer course, how he teaches students to avoid shipping AI slop, and why research, planning, and verification still matter as coding agents become more capable.They discuss Claude Code, agent loops, context engineering, memory and compaction, and how to design MCP to... -
From Slop Code to Software Factories 29.10.2026 47mTwo people, one tandem bike, and a lot of near misses along Amsterdam’s canals. Dexter Horthy, CEO and co-founder of HumanLayer and the person who coined “context engineering,” climbs on the back to talk about a problem every AI-heavy engineering team eventually hits: code that runs today that nobody understands three months later.The ride starts with an old joke from the Claude 3.7 days: ship the slop, it’ll be GPT 7’s problem. That joke is aging badly now that GPT 6 is out and still can’t design clean abstractions. From there it becomes a tour of how agents are actually used right now. Compu... -
Tim O’Reilly 26.10.2026 34mA large language model knows everything and nothing at the same time. Tim O’Reilly, founder and CEO of O’Reilly Media, joins us ahead of his keynote at AGNTCon + MCPCon North America to talk about what that paradox means for the people building with these models.We start with what Tim is bringing to the stage in San Jose, then move to the craft of steering a model. The right words work almost like spells that open up new regions of latent space. Something as small as telling a model to use a computer can unlock a new tier of capability, where agents go off and do real work.From there, the conv... -
AI Agents Need a Babysitter 23.10.2026 45mAI can write your code, choose its own tools, and book your next trip. But who checks that it actually did the job?In this episode of Debug Mode, we explore what it takes to give AI agents more responsibility—and how to keep track of what they’re doing. We discuss intent-based tool selection, MCP and WebMCP, and why a convincing demo doesn’t always translate into reliable automation.We also get into the personal AI assistant everyone seems to be building: one that manages travel, handles household tasks, and hopefully remembers to order coffee before you run out.Then it’s back to code: QA agen... -
Token Maxxing Is Over and Here Is What Comes Next 22.10.2026 35mWhat happens when you give 200 engineers who have barely touched AI a coding assistant and a six-month deadline to rebuild their platform? Pepijn Senders, a principal engineer who previously led AI enablement at HelloFresh, has done exactly that, and he chose Sonnet over Opus on purpose.His reasoning is what he calls "Sonnet maxxing." A model that reasons less and stops sooner keeps developers involved, and that matters a lot when the codebase is banking software full of hard business rules. The result was 800,000 lines of code, about 60% of them written by Sonnet, shipped by a team that never... -
The World Wild Web & Bots With Buying Power 20.10.2026 49mAn AI slips out of its sandbox. A chatbot won’t explain your cat’s stripes. And your next shopping spree might not involve you clicking anything.This episode asks whether “dangerously powerful” AI is a security concern, a marketing pitch, or a little of both. Then we put agents to work: booking trips, tackling German paperwork, drawing diagrams, and navigating the chaos of online shopping. Plus: what happens to checkout, advertising, and customer data when your best customer is a bot?Chapters:[00:00] Is AI Danger the Ultimate Sales Pitch?[00:43] Powerful Models, Payments, and Big Questions[01:... -
Agents Acting Safely on Our Behalf 15.10.2026 23mWhat happens to the web when the ones browsing it are no longer people? Sarah Drasner, Area Tech Lead at Google, sits down with us ahead of her Agentic Web keynote at AGNTCon + MCPCon North America. She works through that question from both directions: rebuild the web so agents can use it properly, or build agents smart enough to handle the web as it already exists.We get into the split between computer-use and browser-use agents on one side and API and MCP agents on the other. We also watch a real example of the idea in action: an agent pulling speaker photos from Flickr, hunting down company... -
Bridging the Gap Between AI Builders and Domain Experts 12.10.2026 22mEveryone is racing to build one agent that can do everything. Justin Schroeder, co-founder of Standard Agents, thinks the future looks more like thousands of tiny ones. Ahead of his talk on domain-specific agents at AGNTCon + MCPCon North America, he explains why tightly scoped agents might be the smarter bet, even if it feels like a step back toward the single-purpose machine learning models of a few years ago.We dig into standards as metadata you pin to an agent, so that it shows up with everything it needs in its harness. Then we test the idea against the obvious objection: if a big model c... -
Inside a Game Where AI Agents Never Sleep 08.10.2026 1h 1mWhat happens to an MMORPG when half the players never log off? Issac Lee, who runs AI and blockchain experiments at NEXUS, has been testing that idea. His team is filling game worlds with agent players instead of scripted NPCs, so a new title feels alive from day one.We get into why agent-generated content could be the next step after studio-made and user-generated games. We also cover how agent populations might solve the chicken-and-egg problem every multiplayer launch faces, and what it means when your fellow players are relentless and never need sleep. Isaac walks through the NEXUS lab: a... -
How a Logistics Giant Keeps AI Data Locked Down 05.10.2026 20mPicture a startup with ten engineers hammering away on AI and one person lying awake over a $20,000 bill that hasn't arrived yet. That's the scenario we put to Jason Ward, who handles FinOps for AI at C.H. Robinson and recently joined the FinOps Foundation's AI working group.Jason's first answer is not glamorous: tag every AI resource so you know who owns it. The rest of the episode is what that makes possible. He walks through how C.H. Robinson runs AI across order entry, quoting, booking, and tracking, and why the team routes Anthropic models through Vertex AI to keep data locked down.Then c... -
The Caveman Prompting Challenge 01.10.2026 44mCaveman prompting has one rule: why use many words when few do the trick? It saves tokens on the way in and on the way out. Push it too far, though, and the output falls apart. So how far is too far? Nobody has benchmarked it yet, and that question opens our conversation with James Barney, Head of Forward Labs at MetLife.James spends his days connecting new AI capabilities to old business problems across dozens of regulatory regimes, and he still finds time to push code. He explains how the FinOps Foundation's AI working group took on the most basic question: which model for which workload, an... -
AWS Has 16,000 APIs. Can MCP Handle It? 28.09.2026 41mWhat happens after you’ve built your first MCP server and actually have to make it work in the real world?In this episode, James Ward dives into the more advanced side of MCP: observability, evals, tool design, code mode, authentication, and the challenges that appear once agents start using your server at scale.We also get into how AWS thinks about MCP across roughly 16,000 APIs, why inefficient tool design often gets blamed on MCP itself, and whether the future could involve more constrained, human-reviewable alternatives to full code mode.Along the way, James shares a great example of an AW... -
Skills over MCP on the streets of Tokyo 24.09.2026 32mTool descriptions tell an agent what a tool does. They don't tell it how to use five tools together, in the right order, following your conventions. That gap is where this conversation lives.Filmed at AGNTCon + MCPCon in Tokyo with Ola Hungerford, Principal Engineer for AI Enablement at Nordstrom and a maintainer of the Model Context Protocol, who spent the last several months turning a pattern everyone was quietly reinventing into an actual MCP extension.Ola walks through what skills over MCP really means: the server stops being a pile of tools and becomes a distribution channel, handing the... -
Walking Tokyo Talking Agent Protocols 18.09.2026 28mTwo people, a wrong turn into a back alley, a community garden, and about thirty minutes of arguing about protocols on the streets of Tokyo.The guest is Angie Jones, VP of Developer Experience at the Agentic AI Foundation, fresh off launching AGNTCon + MCPCon in China before the Tokyo stop. She opens with what she learned there: a mobile-first, super-app world where the integration problem most of us obsess over barely exists, where every conversation about agents is really a conversation about the model, and where companies are now reaching for MCP and A2A precisely because they want to opera... -
Why Cost Per Million Tokens Is A Useless KPI? 14.09.2026 38mA year ago, Palo Alto Networks built dashboards to track AI spend. Today those dashboards are useless, and the team that built them thinks that's the whole story.Recorded at FinOps X in San Diego, this conversation brings together Abhinav Lad, who leads cloud and AI finance at Palo Alto Networks, and Kuntal Patel, who runs the cloud engineering function behind it. They explain what happened when agents entered the picture, and AI stopped behaving like a service anyone could forecast.The short version: consumption went from linear to exponential almost overnight. Agents are goal-oriented rather...
Popular in
The podcast also appears in the podcast charts of these countries.