Kubernetes Bytes

Optimizing AI spend with Cast AI 14.08.2026 55mnt

In this episode of the Kubernetes Bytes podcast, Bhavin talks to Phil Andrews, Global Field CTO at Cast AI about all things AI. The discussion starts by talking about why you don't need an Opus class or Fable/Mythos class model for each task, and how Kimchi from Cast AI can help manage the quality of your output with the cost associated with routing between different models. They also talk about Omni which allows customers to get GPUs across hyperscalers and neocloud providers. Listen to learn more! Check out our website at https://kubernetesbytes.com/ Show Notes: * https://www.linkedin.com/in/philip-andrews-iii/ * https://cast.ai/kimchi/ * https://docs.cast.ai/docs/omni-overview * https://cast.ai/blog/

Securing Kubernetes for the Mythos Era 02.07.2026 58mnt

In this episode of the Kubernetes Bytes podcast, Bhavin talks to Alex Zenla, Founder and CTO of Edera. The discussion starts by talking about why Alex and team decided to start Edera, where in the stack does it fit in, and how can it work with existing Kubernetes clusters. They also talk about GPU security, what Kubernetes DRA is, and how to plan for the new era of Mythos-class models. Listen to learn more! Check out our website at * https://kubernetesbytes.com/ Show Notes: * https://www.linkedin.com/in/azenla/ * https://edera.dev/ * https://github.com/azenla * https://edera.dev/stories

More Code, More Problems: Software Delivery in the Agentic Era 18.06.2026 1j 1mnt

In this episode of the Kubernetes Bytes podcast, Bhavin talks to Rob Zuber, CTO at CircleCI about all things Software Delivery. The discussion starts by talking about the evolution of Software Delivery over the last decade, but then dives into how Vibe coding impacts CI pipelines. Rob also shares his insights about running an AI-first engineering organization at CircleCI. Listen to learn more! Check out our website at https://kubernetesbytes.com/ Show Notes: * https://www.linkedin.com/in/robzuber/ * https://circleci.com/ * https://circleci.com/blog/

Building Grafana Labs and the Future of Observability with Anthony Woods 29.05.2026 52mnt

In this episode of the Kubernetes Bytes podcast, Bhavin talks to Anthony Woods about all things Grafana Labs, Observability, Telemetry, and how AI impacts both of these ecosystems. The discussion starts off by talking about the early days of Grafana Labs, what is Adaptive Telemetry, and how AI plays a role both in building Observability capabilities in applications, and how it helps perform root cause analysis. Listen to learn more! Check out our website at https://kubernetesbytes.com/ Show Notes: * GrafanaCON 2026: https://youtube.com/playlist?list=PLDGkOdUX1UjoSfz1IRj5c0xetw8tl8iin&si=JpT85m4t4bP8ZXgX * Grafana Labs Blog: https://grafana.com/blog/ * https://www.linkedin.com/in/anthonywoods1/

Kubernetes for VMware Admins: Understanding KubeVirt 06.03.2026 58mnt

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Janakiram MSV about all things KubeVirt. The discussion starts off by talking about the need for KubeVirt and then dives into the details of the KubeVirt architecture, and what you need to do when deploying virtual machines on Kubernetes, including commercial solutions like Red Hat OpenShift Virtualization and SUSE Virtualization. Check out our website at https://kubernetesbytes.com/ Show Notes: * https://www.youtube.com/watch?v=DDwfPuWlsl0 * https://janakiram.com/resources/ * https://kubevirt.io/

Secure your Kubernetes applications with Chainguard 09.02.2026 41mnt

Join Ryan Wallner and Bhavin Shah for season 6 of the Kubernetes Bytes podcast. In this episode Bhavin talks to Adrian Mouat, Dev Rel at Chainguard about all things Kubernetes Security. They discuss CVEs, the different vulnerability databases, and how platform engineers can use Chainguard images to protect against CVEs. Links: * https://www.chainguard.dev/ * https://www.linkedin.com/in/adrianmouat/ * https://slsa.dev/

Diving Into Kubernetes: The Developer's First Steps with New Relic 25.03.2025 52mnt

Join Bhavin Shah and Ryan Wallner as they speak with Jemiah Sius, Senior Director of Developer Relations at New Relic to talk about how to get started with learning about Kubernetes. They hosts and Jemiah explore how this has changed within the last 10 years as well as explore what are some good resources for learning and diving in. Links * https://www.linkedin.com/in/jemiahsius/ [https://www.linkedin.com/in/jemiahsius/] * https://newrelic.com/ [https://newrelic.com/] * https://newrelic.com/events/new-relic-now/roadshow * https://www.udemy.com/topic/kubernetes/

Database as a service with Percona Everest 03.03.2025 1j 2mnt

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Edith (Edi) Puclla, Technology Evangelist at Percona to talk about Percona Everest. The conversation focuses on Percona's investment in the Open-source ecosystem, and how they keep innovating with Percona Monitoring and Management and Percona Everest. The discussion also dives into how the community is expanding and supporting more use cases with Data on Kubernetes and AI on Kubernetes. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * http://businesswire.com/news/home/20250227229731/en/Veeam-Releases-Kasten-for-Kubernetes-v7.5-Elevating-its-1-Data-Resilience-Market-Position-with-Enhanced-Security-and-Modern-Virtualization/ * https://www.developer-tech.com/news/kubescape-achieves-major-milestone-in-open-source-kubernetes-security/ * https://thenewstack.io/postgresql-operator-cloudnativepg-hits-the-cncf-sandbox/ * https://backendnews.net/tenable-report-finds-security-gaps-in-kubernetes-environments/ * https://www.infoworld.com/article/3832760/red-hat-openshift-improves-virtualization-support.html * https://edera.dev/stories/series-a - https://www.datastax.com/blog/ibm-plans-to-acquire-datastax Show links: * https://github.com/percona/pmm * https://github.com/valkey-io/valkey * https://github.com/percona/everest * https://github.com/percona/percona-server-mysql-operator * https://github.com/percona/percona-server-mongodb-operator * https://github.com/percona/percona-postgresql-operator * https://forums.percona.com/ * https://github.com/percona * https://www.cncf.io/blog/2024/06/28/celebrating-10-years-of-kubernetes-the-evolution-of-database-operators/ * https://dok.community/ * https://www.linkedin.com/in/edithpuclla/ Timestamps: * 00:07:40 Cloud Native News * 00:17:40 Interview with Edith * 00:58:05 Key takeaways

KubeCon NA 2024 News Recap 18.12.2024 58mnt

Join Bhavin Shah and Ryan Wallner for a recap of announcements and news from KubeCon North America 2024. Check out our website at https://kubernetesbytes.com/ * https://www.businesswire.com/news/home/20241119538933/en/Spectro-Cloud-Closes-75m-Series-C-Led-by-Growth-Equity-at-Goldman-Sachs-Alternatives * https://northflank.com/blog/northflank-raises-22m-to-make-kubernetes-work-for-your-developers-ship-workloads-not-infrastructure * https://snyk.io/news/snyk-acquires-developer-first-dast-provider-probely/ * https://www.nutanix.com/blog/introducing-nutanix-enterprise-ai * https://thenewstack.io/stacklok-donates-minder-security-project-to-openssf/ * https://www.prnewswire.com/news-releases/akamai-launches-cloud-agnostic-ready-to-run-application-platform-302302446.html * https://www.businesswire.com/news/home/20241112064093/en/Loft-Labs-Introduces-vCluster-Cloud-a-Managed-Solution-to-Simplify-and-Reduce-Costs-of-Kubernetes * https://cloud.google.com/blog/products/containers-kubernetes/gke-65k-nodes-and-counting * https://www.veeam.com/resources/wp-whats-new-veeam-kasten-for-kubernetes.html * https://www.netapp.com/blog/trident-24-10-best-storage-kubernetes/ * https://podman-desktop.io/blog/2024/11/14/podman-desktop-cncf * https://aws.amazon.com/blogs/aws/streamline-kubernetes-cluster-management-with-new-amazon-eks-auto-mode/ * https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-eks-hybrid-nodes/ * https://thenewstack.io/kueue-can-now-schedule-kubernetes-batch-jobs-across-clusters/ * https://cloudnativenow.com/kubecon-cnc-na-2024/solo-io-donates-api-gateway-to-cncf-to-advance-kubernetes-connectivity/ * https://blocksandfiles.com/2024/11/08/tintri-unveils-kubernetes-container-storage-interface-for-streamlined-management/ * https://www.sdxcentral.com/articles/stringerai-announcements/kubiya-launches-captain-kubernetes-ai-tool-for-simplifying-kubernetes-management/ * https://cloudnativenow.com/topics/cloudnativedevelopment/application-dev/cncf-automates-kubernetes-secops-with-kyverno/ * https://www.cncf.io/announcements/2024/11/15/cloud-native-computing-foundation-expands-certification-to-platform-engineering-and-more/ * https://training.linuxfoundation.org/platform-engineering-programs * https://cloudnativenow.com/topics/cloudnativedevelopment/cncf-kubevirt-v1-4-vms-are-now-just-another-kubernetes-resource/ * https://kubevirt.io/user-guide/release_notes/ * kubernetes.io/blog/2024/12/11/kubernetes-v1-32-release/ * https://thehackernews.com/2024/12/296000-prometheus-instances-exposed.html?utm_source=tldrdevops

Increasing AI adoption using Kubernetes 06.12.2024 52mnt

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Tobi Knaup, VP and General Manager of Cloud Native at Nutanix about all things Kubernetes and AI. The discussion focuses on how Kubernetes has evolved since the early days, and why it's architecture is a perfect fit for accelerating adoption of AI workloads inside organizations. Check out our website at https://kubernetesbytes.com/ #kubernetes #aimodels #AIonKubernetes #machinelearning #hybridcloud #multicloud #modeltraining

Monolith to Microservices using Kubernetes at Guidewire 07.11.2024 1j 6mnt

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Diego Devalle and Anoop Gopalakrishnan from Guidewire to talk about how they went through an application modernization journey and adopted Kubernetes and cloud over the last 5 years. Diego and Anoop share their experiences around how they drove this modernization inside Guidewire by both championing organizational change, and introducing Kubernetes and cloud technologies, while at the same time ensuring that they serve their existing customers in the insurance industry. Check out our website at https://kubernetesbytes.com/ [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbF9Tclk2WlR5TWZsd05wNE1tNm1GaUp6bDU4UXxBQ3Jtc0tsTlkyYWV2UzgzcEdLazZDREdaUVVzTGV0aTlJWGhrTldNR3JhZ3FxNlMzNW1mM1pzS0VWSWVkd18teXpyVkFJdmJnOVBGcUUyTU15UFpqVVdUTXBId0EzM0lJTjFxT0QtXzBoSXhISmV4bjZ1SFkxZw&q=https%3A%2F%2Fkubernetesbytes.com%2F&v=ZU_KmaWP5gI] Show links: * https://medium.com/@guidewire-engineering * https://www.youtube.com/@GuidewireSoftware * https://www.youtube.com/watch?v=N-WaEneeIJs * https://www.youtube.com/watch?v=bKCwMO4UeJ8 * https://www.guidewire.com/about/careers Timestamps: * 00:05:24 [https://www.youtube.com/watch?v=ZU_KmaWP5gI&t=324s] Interview with Diego and Anoop * 01:02:37 [https://www.youtube.com/watch?v=ZU_KmaWP5gI&t=3757s] Key takeaways

Inference in Action: Scaling Al Smarter with Inferless 24.10.2024 55mnt

In this episode, we sit down with Nilesh Agarwal, co-founder of Inferless, a platform designed to streamline serverless GPU inference. We'll cover the evolving landscape of model deployment, explore open-source tools like KServe and Knative, and discuss how Inferless solves common bottlenecks, such as cold starts and scaling issues. We also take a closer look at real-world examples like CleanLab, who saved 90% on GPU costs using Inferless. Whether you're a developer, DevOps engineer, or tech enthusiast curious about the latest in AI infrastructure, this podcast offers insights into Kubernetes-based model deployment, efficient updates, and the future of serverless ML. Tune in to hear Nilesh's journey from Amazon to founding Inferless and how his platform is transforming the way companies deploy machine learning models. Subscribe now for more episodes! Show Links: * OpenShift 4.17 is GA https://www.youtube.com/live/DvKHwz-c11c?si=6Zap6hk_GsQfdX2m * Policy SBOM from Styra: https://www.styra.com/blog/introducing-policy-sbom/ * NVIDIA GEForce NOW runs on KubeVirt https://thenewstack.io/now-nvidia-scaled-its-cloud-services-with-kubevirt/ * CBT feedback https://thenewstack.io/kubernetes-advances-cloud-native-data-protection-share-feedback * CNCF KUBEEDGE Grad https://www.devopsdigest.com/cncf-announces-kubeedge-graduation?utm_source=tldrdevops * Palumi Operator 2.0 https://www.pulumi.com/blog/pulumi-kubernetes-operator-2-0 Inferless LInks: * https://www.inferless.com/blog/cleanlab-saves-90-on-gpu-costs-with-inferless-serverless-inference * https://www.inferless.com/blog/how-spoofsense-scaled-their-ai-inference-with-inferless-dynamic-batching-autoscaling * https://www.inferless.com/ [https://www.inferless.com/] * https://docs.inferless.com/introduction/introduction [https://docs.inferless.com/introduction/introduction] * LinkedIn - https://www.linkedin.com/in/nilesh-agarwal/ * X- https://x.com/nilesh_agarwal2 * Medium Blog https://nilesh-agarwal.medium.com/

Container security with Wiz 07.10.2024 1j 2mnt

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin talk to Ofir Cohen, CTO of Container Security at Wiz. The discussion focuses on the challenges with the cloud native security ecosystem, how organizations can improve their security posture, how developers can do less with more, and how Wiz helps organizations avoid security incidents. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * https://blog.kubecost.com/blog/2.4-release-highlights/ * https://www.theregister.com/2024/09/26/critical_nvidia_bug_container_escape * https://techcrunch.com/2024/09/18/edera-is-building-a-better-kubernetes-and-ai-security-solution-from-the-ground-up/ * https://www.cncf.io/blog/2024/10/01/karmada-v1-11-version-released-new-cross-cluster-rolling-upgrade-capability-for-workload/ * https://github.com/atlassian/escalator/?tab=readme-ov-file * https://cybenari.com/2024/08/whats-the-worst-place-to-leave-your-secrets/ * https://thehackernews.com/2024/10/new-cryptojacking-attack-targets-docker.html Show links: * https://www.wiz.io/customers * https://www.wiz.io/blog * https://peach.wiz.io * https://www.linkedin.com/in/cohen-ofir/ Timestamps: * 00:01:43 Cloud Native News * 00:12:56 Interview with Ofir * 00:56:58 Key takeaways

Dagger.io Deep Dive with Co-Founder Sam Alba 23.09.2024 1j 6mnt

In this episode, we dive into the challenges of modern CI systems and why they often hinder productivity. We explore Dagger, a programmable CI/CD pipeline engine, with insights from Sam, a former Docker engineer. Learn how Dagger addresses CI complexity, speeds up workflows, and enhances portability between local environments and CI. Show Links * Dagger.io * https://docs.dagger.io/ * https://docs.dagger.io/adopting/#join-our-discord

Running Ray on Kubernetes with KubeRay 05.09.2024 53mnt

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Kai-Hsun Chen, Software Engineer at Anyscale and maintainer of the KubeRay project. The discussion focuses on how the open source Ray project can help organizations use a single tool for data prep, model training, fine tuning and model serving workflows, both for their predictive AI and generative AI models. The discussion also dives into the KubeRay project and how it provides three different Kubernetes CRDs for Data Scientists to deploy Ray clusters on demand. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * https://azure.github.io/AKS/2024/08/23/fine-tuning-language-models-with-kaito * https://orca.security/resources/blog/kubernetes-testing-environment/ * https://www.redhat.com/en/about/press-releases/red-hat-openstack-services-openshift-now-generally-available Show links: * Kai's LinkedIn: https://www.linkedin.com/in/kaihsun1996/ * KubeRay doc: https://docs.ray.io/en/latest/cluster/kubernetes/index.html * Ray Summit registration: https://raysummit.anyscale.com/flow/anyscale/raysummit2024/reg/createaccount (code: KaiHsunC15) * KubeRay repository: https://github.com/ray-project/kuberay * Ray repository: https://github.com/ray-project/ray * Ray Slack workspace: https://docs.google.com/forms/d/e/1FAIpQLSfAcoiLCHOguOm8e7Jnn-JJdZaCxPGjgVCvFijHB5PLaQLeig/viewform Timestamps: * 00:02:40 Cloud Native News * 00:07:20 Interview with Kai * 00:49:15 Key takeaways

Building scalable data platforms using Data on EKS 22.08.2024 1j 2mnt

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Alex Lines and Vara Bonthu from AWS to talk about the Data on EKS project. The discussion dives into why AWS decided to build the Data on EKS project and provide patterns for EKS customers to use to deploy data platforms, machine learning and GenAI tools on EKS clusters. They talk about what's included and what's not included with each of these patterns and whats coming down the line. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * https://kubernetes.io/blog/2024/08/16/kubernetes-1-31-prevent-persistentvolume-leaks-when-deleting-out-of-order/ * https://kubernetes.io/blog/2024/08/16/matchlabelkeys-podaffinity/ * https://kubernetes.io/blog/2024/08/15/kubernetes-1-31-volume-attributes-class/ * https://roadmap.vcluster.com/changelog/vcluster-v020-ga * https://www.cloudbees.com/blog/cloudbees-acquires-launchable-to-enable-development-teams-to-iterate-faster?Product=Launchable&Tag=Blog%2CAI%2CLaunchable%20Update Show links: * https://awslabs.github.io/data-on-eks/ * https://www.youtube.com/watch?v=G9aNXEu_a8k * https://github.com/awslabs/data-on-eks * https://www.linkedin.com/in/alex-lines-aws/ * https://www.linkedin.com/in/varaprofile/ Timestamps: * 00:01:45 Cloud Native News * 00:12:15 Interview with Alex and Vara * 00:58:21 Key takeaways

Deploy and fine-tune LLM models on Kubernetes using KAITO 07.08.2024 44mnt

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Sachi Desai, Product Manager and Paul Yu, Sr. Cloud Advocate at Microsoft to talk about the open source KAITO project. KAITO is the Kubernetes AI Toolchain Operator that enables AKS users to deploy open source LLM models on their Kubernetes clusters. They discuss how KAITO helps with running AI-enabled applications alongside the LLM models, how it helps users bring their own LLM models and run them as containers, and how KAITO helps them fine-tune open source LLMs on their Kubernetes clusters. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * https://azure.github.io/AKS/2024/07/30/azure-container-storage-ga * https://github.blog/news-insights/product-news/introducing-github-models/ Show links: * Azure/kaito: Kubernetes AI Toolchain Operator - https://github.com/Azure/kaito/tree/main * https://www.youtube.com/watch?v=3cGmHDjR_3I&list=PLc3Ep462vVYtgN4rP1ThTJd2UlsBc2sou&index=2 * https://aka.ms/cloudnative/learnlive/intelligent-apps-on-aks/episode-2 * Jumpstart AI Workflows With Kubernetes AI Toolchain Operator - The New Stack - https://thenewstack.io/jumpstart-ai-workflows-with-kubernetes-ai-toolchain-operator * https://paulyu.dev/article/soaring-with-kaito/ * Concepts - Fine-tuning language models for AI and machine learning workflows - Azure Kubernetes Service | Microsoft Learn - https://learn.microsoft.com/en-us/azure/aks/concepts-fine-tune-language-models * Keep up to date on the most recent announcements by following some of the KAITO engineers on LinkedIn: 1. Fei Guo - https://www.linkedin.com/in/fei-guo-a48319a/ 2. Ishaan Sehgal - https://www.linkedin.com/in/ishaan-sehgal/ Timestamps: * 00:02:15 Cloud Native News * 00:05:34 Interview with Sachi and Paul * 00:42:08 Key takeaways

The business case for cloud-native and Kubernetes 26.07.2024 54mnt

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Danielle Cook - VP of Marketing, appCD and Co-chair, CNCF Cartografos Working Group, CNCF. The discussion dives into how technical individual contributors can and should think about a business case for cloud native adoption. They talk about the cloud native maturity model and also discuss the different things business leaders care about. Check out our website at https://kubernetesbytes.com/ Cloud Native News: * https://www.chainguard.dev/unchained/chainguard-series-c * https://www.cnbc.com/2024/07/23/google-wiz-deal-dead.html * https://www.redhat.com/en/blog/what-you-need-to-know-red-hat-openshift-416 * https://blog.kubeflow.org/kubeflow-1.9-release/ * https://talks.devopsdays.org/devopsdays-boston-2024/cfp Show links: * https://www.linkedin.com/in/danielle-cook-/ * https://maturitymodel.cncf.io/ * https://community.cncf.io/cncf-cartografos-working-group/ * https://tag-app-delivery.cncf.io/whitepapers/platform-eng-maturity-model/ Timestamps: * 00:01:36 Cloud Native News * 00:12:07 Interview with Danielle * 00:51:20 Key takeaways

Building the AI Hyperscaler with Kubernetes 28.06.2024 54mnt

In this episode of the Kubernetes Bytes podcast, Bhavin sits down with Brandon Jacobs, an Infrastructure architect at Coreweave. They discuss how Coreweave has adopted Kubernetes to build the AI hyperscaler. The discussion dives into details around how Coreweave handles Day 0 and Day 2 operations for AI labs that need access to GPUs. They also talk about lessons learnt and best practices for building a Kubernetes based cloud. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Nethopper Learn more about KAOPS: nethopper.io For a supported-demo: info@nethopper.io Try the free version of KAOPS now! https://mynethopper.com/auth Cloud Native News: * https://siliconangle.com/2024/06/24/ollama-addresses-remote-execution-flaw-following-wiz-discovery/ * https://siliconangle.com/2024/06/18/suse-acquires-kubernetes-observability-startup-stackstate/ Show links: * https://www.linkedin.com/in/brandonrjacobs/ * https://www.coreweave.com/ Timestamps: * 00:01:39 Cloud Native News * 00:05:30 Interview with Brandon * 00:51:37 Key takeaways

Shifting Minds: Exploring OpenShift's AI Landscape 14.06.2024 1j 5mnt

Ryan Wallner and Bhavin Shah talk to Andy Grimes about the OpenShift AI Landscape. Check out our website at https://kubernetesbytes.com/ Episode Sponsor: Nethopper * - Learn more about KAOPS: @nethopper.io * - For a supported-demo: info@nethopper.io * - Try the free version of KAOPS now! https://mynethopper.com/auth Links * - https://youtube.com/watch?v=nAT9U1vJ8x0 * - https://www.theregister.com/2024/06/12/kubertenes_decade_anniversary/ * - https://www.businesswire.com/news/home/20240606882860/en/Mirantis-Collaboration-with-Pure-Storage-Simplifies-Data-Management-with-Kubernetes * - https://falco.org/blog/falco-0-38-0/ * - https://au.finance.yahoo.com/news/rancher-government-successfully-using-harvester-121100125.html * - https://www.youtube.com/@PlatformEngineering * - Video: https://www.youtube.com/watch?v=tZj8j3fdXy4 * - Virtual Road Shows: https://www.redhat.com/en/north-america-red-hat-aws * - AWS Gameday August 22nd: TBS * - Boston Childrens Hospital RHOAI: https://www.redhat.com/en/creating-chris * - IBM Open Source AI https://www.youtube.com/watch?v=SuGedexBudQ&t=141s

Kubernetes Bytes

Episode

Podcast serupa

Populer di