Data Engineering Central Podcast
Data Engineering in Real Life
0
A podcast dedicated to data engineering, covering news, topics, and general mayhem in the field. Hosted by Data Engineering in Real Life, it offers no-holds-barred discussions for data engineers.
Episodes
-
AI Is Changing Software Engineering Forever | Gregor Ojstersek 11.11.2026 53mWhat happens to software engineers when AI can write most of the code?In this episode of the Data Engineering Central Podcast, I sit down with Gregor Ojstersek, former CTO, author of The Multiplier Mindset (O’Reilly), and creator of the Engineering Leadership Newsletter, which recently surpassed 200,000 subscribers.We dive into the changing world of software engineering, why technical skills alone aren’t enough anymore, and what it takes to become a successful engineer and engineering leader in the age of AI.Gregor shares his journey from self-taught programmer to CTO, how he built one of the... -
Life After Big Tech 04.11.2026 50mWhat happens when you finally achieve financial independence, walk away from a successful career in Big Tech, and have the freedom to do whatever you want? Is it everything you imagined it would be?In this episode of the Data Engineering Central Podcast, I’m joined once again by Kevin Martin, who spent nearly 13 years working at Apple before deciding he’d had enough of the corporate grind. When we last spoke, Kevin had just left Apple and was preparing to spend much of 2026 backpacking some of America’s most beautiful wilderness.Thanks for reading Data Engineering Central! This post is public... -
AI Is a Mirror: MLOps, LLMOps & the Future of AI Engineering | Maria Vechtomova 30.09.2026 49mWhat does it actually take to build AI systems that work in production?In this episode of Data Engineering Central, I sit down with Maria Vechtomova, AI Engineering Lead, co-founder of CAUCHY, Databricks MVP, and author of MLOps with Databricks.Maria has spent more than 12 years working across data, machine learning, MLOps, and AI engineering. We talk about how production ML has evolved from the early days of homegrown model platforms to today’s world of LLMs, agents, Databricks, MLflow, and AI-assisted coding.We dig into why LLM applications can be significantly harder to evaluate and monitor... -
The Future of Data Engineering in the Age of AI | Erfan Hesami 16.09.2026 46mI sat down with Erfan Hesami, founder of Pipeline to Insights, to talk about where data engineering is headed as AI and agents become part of everyday engineering work.We dig into the changing role of the data engineer, the growing overlap between data and AI engineering, and why strong fundamentals may actually become more important as AI makes writing code cheaper and easier.We also talk about AI agents inside modern data platforms, governance and security, AI-generated code and technical debt, controlling AI costs, the importance of human judgment, and why communication and business skills... -
Big Tech Laid Him Off. He Realized He Didn’t Need a Job. — Asian Dad Energy 09.09.2026 49mWhat happens when you spend decades building a successful career in tech, finally reach Big Tech, and then suddenly get laid off?In this episode of the Data Engineering Central Podcast, I sit down with AsianDadEnergy to talk about his journey from writing BASIC on an IBM 386 and working with COBOL mainframes to consulting, becoming a chief architect in Big Tech, and eventually losing his job after seven years.But the layoff wasn’t the end of the story.Years earlier, the 2008 financial crisis convinced him and his wife to live below their means, eliminate debt, save aggressively, and invest. By... -
Spark Isn't Going Anywhere. So They Rebuilt It in Rust. — Shehab Amin, CEO of LakeSail 02.09.2026 56mIn this episode, I sit down with Shehab Amin, co-founder and CEO of LakeSail, to talk about what happens when you decide to rebuild one of data engineering’s most important technologies, Apache Spark, in Rust … sorta.We dig into Shehab’s journey from writing C++ as a kid to studying computer science at Berkeley, becoming a founder, and eventually building Sail. We talk about why Spark has remained so sticky, what Rust, Apache Arrow, and DataFusion are changing about data infrastructure, and why rebuilding Spark compatibility turned out to be much harder—and more interesting—than expected.We al... -
Agentic Data Engineering Is Here — But Can It Close the Loop? 22.07.2026 33mAI can now write SQL, generate Python, review pull requests, and build entire applications with a few well-crafted prompts. Yet despite all of that progress, data engineering still feels oddly resistant to the full AI revolution. Pipelines break. Data models drift. Production data needs validation. Someone still has to close the loop.In this episode of the Data Engineering Central Podcast, I sat down with Hugo Lu, founder and CEO of Orchestra, to talk about what “agentic data engineering” actually means beyond the buzzwords. Rather than another conversation about AI replacing engineers, we dug... -
What Happens When a Software Engineer Builds a Company Alone? 15.07.2026 47mWhen people think about starting a software company, they usually imagine raising venture capital, hiring engineers, and growing a team as quickly as possible.Michael Drogalis chose a different path.After helping build technology in the Kafka ecosystem, founding a startup that was ultimately acquired by Confluent, and leading product for stream processing, he walked away from big tech to see if one person could build a serious B2B software company.* The result became ShadowTraffic, a product that helps engineering teams generate realistic production traffic for testing, demos, and development.... -
The Creator of Pandas on AI, Apache Arrow, and the Future of Software Engineering 08.07.2026 1hThe creator of Pandas and co-creator of Apache Arrow, Wes McKinney, joins the Data Engineering Central Podcast for an in-depth conversation about how modern data engineering came to exist, where AI is taking software development, and why good engineering still matters more than ever.We start with Wes’ journey from building GoldenEye fan websites as a teenager to creating Pandas while working at a quantitative hedge fund, and eventually launching Apache Arrow, one of the foundational technologies behind today’s modern data ecosystem. Along the way, we discuss Cloudera, Parquet, DuckDB, DataFusi... -
From COBOL to Copilot: 30 Years of Data, BI, and AI with David Langer 01.07.2026 56mWhat happens when someone who started programming on a Commodore 64 watches AI reshape the entire data industry?In this episode of the Data Engineering Central Podcast, I sit down with Dave Langer to explore nearly three decades of experience across software engineering, business intelligence, analytics, data science, and AI.Dave’s career spans COBOL programming on IBM mainframes, enterprise architecture, Microsoft’s Xbox division, machine learning, startup leadership, authorship, and building one of the largest personal brands in the data space.We discuss why many of the biggest problems in d... -
Semantic Layers, Agents, and the Future of Analytics 24.06.2026 44mIn this episode of the Data Engineering Central Podcast, I sit down with David Jaitillake to explore the future of data engineering, analytics, and AI. David has spent nearly two decades working across data teams, from analyst roles in the early SQL Server days to leading teams, founding startups, serving as VP of AI at Cube, and now co-founding Quarry.We discuss why semantic layers have suddenly become one of the most important concepts in modern data platforms, how tools like Claude Code are transforming engineering workflows, and why the core problems in data haven’t really changed despite... -
The Future of the Lakehouse: Delta Lake, Rust, and Data Platforms at Scale 17.06.2026 55mIn this episode of the Data Engineering Central Podcast, I sit down with Ethan, a maintainer of delta-rs and an expert in modern lakehouse architecture working in the pharmaceutical industry.We discuss Ethan’s journey into tech and data engineering, the evolution of open table formats like Delta Lake and Apache Iceberg, and what it actually takes to build scalable enterprise data platforms in highly regulated environments like big pharma.We also dive into:* delta-rs and the future of Delta Lake outside Spark* Lakehouse architecture and open catalogs* Rust in the modern data ecosystem* Data pla... -
From Failure to AWS: What Actually Makes a Great Engineer 10.06.2026 52mVictor Moreno went from failing out of a top CS program to becoming a senior engineer at AWS, and his story says a lot about what actually matters in software engineering today.In this conversation, we go deep into the reality behind the AI hype, what makes engineers valuable (it’s not writing more code), and why the future of the field looks very different from what most people think.We talk about the shift from coding to system thinking, why fundamentals matter more in the age of AI, and how junior engineers will need to evolve as tools like Claude and ChatGPT take over the “grunt work.”Vict... -
How Real Data Engineers Think (Beyond Tools and Hype) 03.06.2026 49mIn this episode of the Data Engineering Central Podcast, I sit down with Yordan Ivanov, Head of Data Engineering at a growing fintech company, to talk through what it actually looks like to build and run real data platforms in production.Yordan’s story starts like many of mine, early programming, gaming, PHP, Linux servers—but what makes this conversation interesting is how he evolved from a generalist software engineer into a data engineering leader without even realizing it at first.We spend a lot of time digging into what actually matters in modern data engineering, and it’s not the tools.T... -
Data, AI, and DuckDB 27.05.2026 49mIn this episode of the Data Engineering Central Podcast, I sit down with Jacob Matson, Developer Advocate at MotherDuck, to unpack one of the most interesting shifts happening in data engineering right now.Jacob didn’t start in tech the way most people expect. He began in accounting, working with Excel and financial systems, before slowly realizing that the real problem he loved solving wasn’t finance, it was data pipelines. That path eventually led him deep into SQL Server, data warehousing, and ultimately to DuckDB, a tool that fundamentally changed how he thought about processing data.* Wha... -
Why I Left Facebook to Work for Myself 20.05.2026 52mIn this episode of the Data Engineering Central Podcast, I sit down with Ben Rogojan to talk about the real story behind data engineering careers, Big Tech, and what’s changing right now.Ben shares how he went from working in kitchens… to data engineering… to Facebook… and eventually walking away from it all to build his own consulting business.And yeah, it wasn’t all glamorous.“I was making the same money as Facebook… and I hated my life.”We get into the stuff most people don’t talk about:* What it’s actually like working in Big Tech* Why high-paying jobs can still burn you out* How he transi... -
Academic → CTO: What Actually Matters in Data (Matthew Housley) 13.05.2026 55mMost companies don’t have a tooling problem. They have a foundation problem.In this episode, I sit down with Matthew Housley, a famed co-author of Data Engineering Fundamentals and former CTO of Ternary Data, to talk about what actually makes data teams successful and why so many organizations get it wrong despite having modern stacks, cloud platforms, and expensive dashboards.* Matthew’s path is a little different than most. He started in academia as a mathematics instructor before moving into industry as a data scientist at Overstock.com, and eventually leading data strategy and analytics as... -
AI Isn’t Replacing Curious Developers 06.05.2026 1h 3mAI isn’t just changing how we write code. It’s changing what it even means to build software.In this episode of the Data Engineering Central Podcast, I sit down with Neil Roberts — a developer who’s been through every major wave of the web, from BASIC on an Atari to modern TypeScript, and now deep into LLMs and agentic workflows.This is not another surface-level “AI will change everything” conversation. We get into what is actually happening right now, where it works, where it completely breaks, and what developers are getting wrong.* We talk about why front-end and UX matter more than ever in... -
AI Is Changing Data Engineering Fast 29.04.2026 56mIn this episode of the Data Engineering Central Podcast, I sit down with Andreas Kretz to break down what is really happening in the industry right now. We go far beyond surface-level AI hype and talk about how data engineering actually works in the real world, what skills still matter, and where most engineers are wasting time.Andreas shares his full journey from industrial IoT and working at Bosch to building one of the largest data engineering education platforms in the world, training over 2,000 students and reaching more than 100,000 engineers globally. We get into what production data sy... -
Most Data Teams Are Doing It Wrong 22.04.2026 58mMost data teams think they’re building value. In reality, they’ve become ticket queues.In this episode, Chris Gambill explains his storied career in tech and data through the years, dealing with data at Fortune 500 company scale, and breaking out on his own.We cover career growth, what separates senior engineers from true strategic operators, and the biggest mistakes people make early on. We discuss the classic problems that have plagued data teams for decades and why it’s all still a struggle.Today’s podcast is sponsored by Estuary.Without them, content like this isn’t possible. The best way...
Popular in
The podcast also appears in the podcast charts of these countries.