Beyond The Pilot: Enterprise AI in Action
VentureBeat
0
AI gets real here. On “Beyond the Pilot,” top business execs share what actually happens after the AI proof of concept — from infrastructure and org design to wins, failures, and ROI. Not theory, but deep dives into how they scaled AI that works.
Episodes
-
How Clementine is growing Instacart’s baskets with Instacart CTO Anirban Kundu 18.11.2026 40mInstacart's CTO stopped his engineers from reading code. 97% of their codebase is now AI-generated — and they've cut the cost of serving Clementine, their AI shopping agent, to one-eighth of what it was eight months ago. Anirban Kundu (AK), CTO of Instacart, breaks down the internal architecture behind that number. The core insight: the harness matters more than the model. Instacart built a proprietary system called Maverick that routes planning tasks to frontier models and code generation to faster, cheaper open-source models like Luna and DeepSeek — cutting development AI costs by 75% while... -
How SaaS Wins in World of Agents with BOX CTO Ben Kus 05.11.2026 34mAI agents can now be weaponized to run elite-level cyberattacks at scale — and your perimeter won't stop them. Box CTO Ben Kus lays out exactly how enterprises defend against agentic threats without locking down the tools their teams actually need. Ben Kus spent years at IBM's BigFix patching vulnerabilities at enterprise scale. Now at Box — where 95% of the codebase is permissions, security, and compliance — he's dealing with a new threat model: cheap, scalable AI agents that give any attacker access to elite hacking capabilities previously limited to nation-state actors. Only 14% of companie... -
Why Home Depot Refuses to Build One Big AI Agent 21.10.2026 42mHome Depot cut delivery failure rates from 5.3% to 2.8% in Chicago using a purpose-built agentic system — and it's protecting 1.5 million at-risk deliveries a year across weather, geospatial, and customer preference signals. Home Depot CIO Angie Brown breaks down exactly how the sixth-largest U.S. e-commerce operation ($25B+ in online sales, 2,300+ stores) built its production AI stack from the ground up. The architecture is a layered agent hierarchy: a thin client planner routes to domain agents (selling, post-purchase, delivery), which hand off to fine-grained sub-agents by category — paint,... -
AI Engineering: Measure the PRs not the Code 14.10.2026 32mA $600 day of AI coding spend sounds alarming — until you divide it by the PRs shipped. At ~$30/PR, it reframes the entire ROI conversation: the spend isn't the problem, spend with no return is. This episode comes from a live panel Sam moderated at VentureBeat Transform, featuring Emilie Schario (Kilo Code, acquired by Anaconda the morning of the panel), Amol Jain (Replit), and Jared Go (Symbiotic). The conversation cuts straight to what agentic coding actually looks like in production — not in demos. On architecture: Kilo routes across 500+ models and processes 10 trillion tokens/month, using... -
Routing Wars: Which Model Gets the Workload? 08.07.2026 14m66% of enterprise AI teams are actively engineering toward zero human oversight — but only 4.5% fully trust their automated evals. Half have already shipped an agent that passed evals and still failed a real customer. VentureBeat's latest research exposes a dangerous gap between deployment ambition and evaluation maturity. The most-used eval platform is OpenAI's native tooling. The second most common answer: no dedicated eval platform at all. Meanwhile, 51% of enterprises are relying on a hyperscaler's built-in guardrails as their primary AI security layer — not a deliberate security architect... -
Small Models, Massive Wins: The New Shopify AI Formula 24.06.2026 44mShopify's distillation pipeline cuts production AI costs by up to 30x — and in some cases, the smaller model outperforms the frontier model on the narrow task. That's not a trade-off. That's a win on accuracy, latency, and cost simultaneously. Farhan Thawar, VP & Head of Engineering at Shopify, runs AI across one of the largest commerce platforms on earth. In this episode, he breaks down the exact infrastructure decisions Shopify made to avoid being locked into any single model provider — and why 29% of enterprise AI projects die from token costs, not model failure. Shopify built an internal L... -
Weaponize Tokenmaxing: MassMutual’s ROI Engine 10.06.2026 35mIf you enjoy these conversations, you need to be in Menlo Park this July. VB Transform 2026 is VentureBeat's flagship enterprise AI event, built entirely around one question: How do you orchestrate AI autonomy at scale? July 14–15, Hotel Nia. Real projects, proprietary research, no fluff. 50% off for listeners with code BEYONDTHEPILOT: https://bit.ly/4fK4F6z _ He negotiated seat-based (unlimited) licenses before token costs exploded — and projects only a 20–30% spend increase when that changes. MassMutual's CIO rebuilt a COBOL mainframe app into a working web prototype in 7 days — work that us... -
Building a 30% Better AI: The Taste Graph Moat 27.05.2026 33mPinterest's open-source AI stack costs 90% less than frontier models — and their custom-trained recommender outperforms off-the-shelf alternatives by 30% in accuracy. Pinterest CTO Matt Madrigal breaks down exactly how they did it, and what enterprise AI teams can actually replicate. Madrigal walks through the full architecture behind Navigator 1, Pinterest's conversational shopping assistant built on Qwen 3 VL — and the specific decision to rip out its native vision encoder and replace it with PinCLIP, Pinterest's proprietary multimodal embedding layer. That swap alone closes a 20x inference... -
GPU Hoarding is Over. The $401B Reality Check 13.05.2026 15mEnterprise GPU hoarding is over. LinkedIn CTO Erran Berger and VentureBeat analyst Rob Strechay break down what comes next — and the infrastructure math most enterprises are only now being forced to confront. VentureBeat's Q1 research shows GPU availability anxiety dropped from 20.8% to 15.4% among enterprise teams, while cost-per-inference and TCO concerns jumped from 34% to 41% — a number that's still climbing. The hoarding phase is giving way to an audit phase, and the companies that didn't build the instrumentation to understand their workloads are now paying for it. Erran Berger explains... -
Agents Ate the UI: Data is Your Only Moat with LlamaIndex 29.04.2026 45mThe CEO who built one of the most-starred RAG frameworks on GitHub (47,000 stars) just publicly declared that frameworks like his are becoming obsolete — and then pivoted his entire company around that conclusion. Jerry Liu, CEO and co-founder of LlamaIndex, joins Matt Marshall and Sam Witteveen to explain exactly what broke in the AI stack, why 95% of his team's code is now AI-generated, and where the real defensibility in enterprise AI infrastructure actually lives in 2026. The conversation covers the specific architectural shift that made RAG orchestration frameworks less central: agent rea... -
The Protocol Stack AI Is Missing 15.04.2026 50mCisco's OutShift deployed a multi-agent network configuration system that raised error detection from 10–15% to 100% and cut full change validation from 2–3 weeks to 6–7 minutes. The reason it worked — and why most enterprise multi-agent deployments still fail — comes down to a single gap nobody is talking about: agents can connect, but they cannot think together. Vijoy Pandey, SVP and General Manager of OutShift by Cisco, joins Matt and Sam to explain why A2A, MCP, and existing agent protocols solve connectivity but leave out an entire layer: shared cognition. OutShift's research identifies t... -
100M Agents: Scaling the New Execution stack with Intuit 01.04.2026 38mA QuickBooks customer discovered significant fraud by asking their AI assistant follow-up questions about transaction amounts that didn't add up. This isn't a demo — it's one of 3 million customers now using Intuit's AI agents in production, with 80.5% returning to use them again. Marianna Tessel, EVP and GM of QuickBooks (formerly CTO of Intuit), walks through the architecture decisions behind one of the first enterprise AI deployments at true scale. Intuit's "done-for-you" agents now automate book closing, reconciliation, transaction categorization, and payroll — but the breakthrough came wh... -
The AI War For Your Personal Context 18.03.2026 20mMajor SaaS companies including Salesforce, Intuit, and ServiceNow saw stock drops of 45-50% as enterprises shift from bloated software suites to personalized AI agents that users can control directly. Microsoft just capitulated this week, opening Copilot to allow Claude Cowork-style functionality — a clear signal that the "build vs. buy" calculus for enterprise software has fundamentally changed. Matt Marshall and Sam Witteveen break down why personalization is no longer optional for enterprise products. Companies like Zoom now offer personalized workflows that access your conversation history... -
LangChain: What OpenClaw Got Right (And Why Enterprises Can't Have It) 04.03.2026 56mLangChain told employees they cannot install OpenClaw on company laptops due to "massive security risk" — yet this unhinged approach is exactly what makes it work. Harrison Chase unpacks why OpenClaw succeeds where AutoGPT failed, and why context engineering, not just smarter models, separates demo agents from production-ready systems. The shift is architectural: Modern agent harnesses like Claude Code now dump 40,000-token API responses to file systems instead of cramming them into message history. LangChain's Deep Agents framework emerged from reverse-engineering Claude Code, Codex, and Deep... -
LexisNexis on Why Standard RAG Fails in Law 18.02.2026 35mOn February 2nd, a single plugin wiped nearly $800 billion off the enterprise software market. Wall Street is terrified that AI agents are about to eat the legal industry's lunch. But LexisNexis isn't scared—they're building the moat. In this episode of Beyond the Pilot, Min Chen (Chief AI Officer, LexisNexis) reveals the sophisticated architecture they built to counter the "LLM wrapper" revolution. Moving beyond standard RAG, Min breaks down their move to "GraphRAG", their deployment of Agentic workflows (using Planner and Reflection agents), and why they created a proprietary "Usefulness Sco... -
Mastercard's 160 Billion Transactions: AI's Biggest Test 04.02.2026 55mWhile most of the world is still running GenAI pilots, Mastercard is running AI inference on 160 billion transactions a year—with a hard latency limit of 50 milliseconds per score. In this episode of Beyond the Pilot, Johan Gerber (EVP of Security Solutions) and Chris Merz (SVP of Data Science) open the hood on one of the world's largest production AI systems: Decision Intelligence Pro. They reveal how they moved beyond legacy rules engines to build Recurrent Neural Networks (RNNs) that act as "inverse recommenders"—predicting legitimate behavior faster than the blink of an eye. AI Gets Real H... -
Inside LinkedIn’s AI Engineering Playbook 21.01.2026 40mWhile the rest of the industry chases massive models, LinkedIn quietly achieved a major engineering breakthrough by going small. In this episode of Beyond the Pilot, Erran Berger (VP of Product Engineering, LinkedIn) opens the "cookbook" on how they distilled massive 7B parameter models down to ultra-efficient 600M parameter "student" models—scaling AI to 1.2 billion users without breaking the bank. AI Gets Real Here. This isn't theory. Erran details the exact architecture, the "Multi-Teacher" distillation process, and the organizational shift that forced Product Managers to write evals instea... -
Most enterprise AI agents are Slop - here’s why they fail 07.01.2026 1h 3mThe "TAM" for AI Agents isn't software. And there is a $10 Trillion opportunity. In this episode, Replit CEO Amjad Masad reveals why 99% of today's enterprise AI agents are just "Slop"—unreliable, generic toys that fail in production. We dive deep into the engineering reality of building autonomous agents that actually work, moving beyond simple chatbots to systems that can navigate the messy reality of enterprise infrastructure. Amjad breaks down Replit’s "Computer Use" hack that makes agents 10x cheaper than generic models, explains why "Vibe Coding" is the future of the C-Suite, and issues... -
How JPMorgan Engineered a 30K AI Agent Economy 17.12.2025 46mInside the 'Agent Economy': How 30,000 AI Assistants Took Over JPMorgan While most enterprises were scrambling after ChatGPT launched, JPMorgan Chase was already two years ahead. 🚀 In this episode of Beyond the Pilot, we sit down with Derek Waldron, Chief Analytics Officer at JPMorgan Chase, to reveal how the world’s largest bank built an internal AI platform that is now used by 1 in 2 employees daily. Derek shares the contrarian insight that drove their strategy: AI models are commodities; the real moat is connectivity. Learn how they scaled from zero to 250,000+ users, why they empowered em... -
How Booking.com Boosted Agent Accuracy 2x with Mini LLMs with Pranav Pathak 03.12.2025 45mWe built AI agents by accident... and it worked. 🤯 In this episode of VentureBeat’s Beyond the Pilot, we go inside the engineering brain of Booking.com with Pranav Pathak (Director of Product Machine Learning). Pranav reveals how they "stumbled" into agentic architectures before the term even existed, how a simple text box revealed a massive missed revenue opportunity (the "Hot Tub" story), and exactly how they stack LLMs, RAG, and Orchestrators to handle millions of travelers without breaking the bank. If you are building Enterprise AI, this is the blueprint for moving from "cool demo" to pr...
Popular in
The podcast also appears in the podcast charts of these countries.