AI agents were all over KubeCon. Production is another story
At KubeCon + CloudNativeCon North America 2026 in Salt Lake City, The New Stack’s Frederic Lardinois sat down with Jonathan Bryce, executive director of the Cloud Native Computing Foundation (CNCF), to discuss how AI is reshaping cloud native infrastructure, open source innovation, and the developer community.
Bryce explains why Kubernetes and cloud native technologies are becoming increasingly essential as AI agents introduce workloads that demand greater scalability, resilience, and efficiency. He highlights new CNCF projects, including Open Shell and Agent Substrate, alongside llm-d, which aim to improve AI security, resource utilization, and infrastructure performance while addressing growing concerns about energy consumption and operational costs.
The conversation also explores the surge in AI-assisted vulnerability discoveries, the mounting pressure on open source maintainers, and the importance of industry collaboration to strengthen software security.
Looking ahead, Bryce emphasizes that enterprise AI agent adoption remains in its early stages, giving the open source community an opportunity to build the secure, efficient, and scalable foundations needed for widespread deployment.
Learn more from The New Stack about the latest developments around cloud native community:
Why agent harnesses fail inside cloud-native systems
Cloud native application challenges: installing the walking skeleton
After becoming cloud computing’s telemetry standard, OpenTelemetry graduates into the AI infrastructure era
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
New CNCF report: 75% of cloud-native developers ship code with AI. Jonathan Bryce explains why.
AI adoption is accelerating among cloud-native developers, who are leading the charge in integrating artificial intelligence into software development. According to the Cloud Native Computing Foundation’s (CNCF) Q3 2026 State of Cloud Native Development report, 21.2 million developers—41% of the global developer population—work with cloud-native technologies. Of those, 75% use AI to write and ship code, compared with just 50% of non-cloud-native developers.
In this episode of The New Stack podcast, CNCF Executive Director Jonathan Bryce discusses the rapid growth of the cloud-native ecosystem, evolving developer trends, and the expanding role of open source in driving innovation.
Bryce highlights CNCF’s project maturity process, from sandbox to incubation and graduation, and explores emerging technologies such as KubeRay and Agent Substrate alongside graduating projects including KubeVirt, Karmada, and Kubeflow.
The conversation also examines the Kubernetes AI Conformance program and why understanding open-source technologies is increasingly essential for organizations seeking flexibility, innovation, and competitive advantage in an AI-driven world.
Learn more from The New Stack around the latest developments around the State of the Cloud and the evolving cloud native ecosystem.
Cloud native application challenges: installing the walking skeleton
Cloud Realities Are Slowing AI Ambitions
After becoming cloud computing’s telemetry standard, OpenTelemetry graduates into the AI infrastructure era
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
The CNCF is graduating projects faster than ever. AI agents are helping with the due diligence.
Open-source technology has played a foundational role in the AI boom, giving companies the flexibility to scale unprecedented computing workloads across providers and hardware. OpenAI, for example, used Kubernetes as early as 2018 to balance compute across its own data centers, AWS and Azure — years before ChatGPT brought generative AI into the mainstream.
CNCF Executive Director Jonathan Bryce sees a powerful feedback loop emerging between AI and open source. Early AI companies relied on open-source tools because commercial products couldn’t support the scale and complexity of their work. As those companies contribute back, enterprises across industries gain access to increasingly sophisticated AI infrastructure.
AI is now accelerating open-source development itself. CNCF has used agents to assist with project due diligence, helping move projects through its graduation process faster. As AI agents increase development speed and infrastructure demands, Bryce argues that open-source communities will be critical for addressing challenges including multi-cloud computing, hardware diversity, guardrails and software capable of operating at agent speed.
Learn more from The New Stack around the latest open source and AI developments:
Open-source AI is just "4 months behind" closed frontier models - and 10x cheaper
Is AI killing open-source software?
Open source maintainers are drowning in AI-generated pull requests. Enterprise teams are next.
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
The next stages of AI conformance in the cloud-native, open-source world
Running AI models on Kubernetes has historically been inconsistent, with workloads behaving differently across cloud providers due to variations in GPUs, networking, and autoscaling. As organizations move AI from experimentation to production, standardization has become critical. In this episode of The New Stack Makers, Jonathan Bryce, Executive Director of The Cloud Native Computing Foundation shared that the Foundation’s Kubernetes AI conformance program aims to solve this by ensuring portability, predictability, and production readiness for AI workloads across environments.
The initiative reflects a broader industry shift: AI is moving from training-heavy workloads to inference at scale, with inference expected to dominate compute usage by the end of the decade. Unlike batch-based training, inference requires real-time, always-on performance, making Kubernetes an attractive platform due to its elasticity, GPU-aware autoscaling, and observability.
The conformance program establishes baseline standards for handling accelerators like GPUs and TPUs, reducing vendor lock-in and simplifying deployment. Early adopters include major cloud providers and ecosystem players, while new projects like llm-d aim to bridge orchestration and inference. As requirements evolve, ongoing collaboration and recertification will ensure the standards stay aligned with real-world needs.
Learn more from The New Stack about the latest developments around The Cloud Native Computing Foundation’s Kubernetes AI conformance program:
CNCF: Kubernetes is ‘foundational’ infrastructure for AI
Kubernetes Gets an AI Conformance Program — and VMware Is Already On Board
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
Why the CNCF's New Executive Director is Obsessed With Inference
Jonathan Bryce, the new CNCF executive director, argues that inference—not model training—will define the next decade of computing. Speaking at KubeCon North America 2025, he emphasized that while the industry obsesses over massive LLM training runs, the real opportunity lies in efficiently serving these models at scale. Cloud-native infrastructure, he says, is uniquely suited to this shift because inference requires real-time deployment, security, scaling, and observability—strengths of the CNCF ecosystem.
Bryce believes Kubernetes is already central to modern inference stacks, with projects like Ray, KServe, and emerging GPU-oriented tooling enabling teams to deploy and operationalize models. To bring consistency to this fast-moving space, the CNCF launched a Kubernetes AI Conformance Program, ensuring environments support GPU workloads and Dynamic Resource Allocation. With AI agents poised to multiply inference demand by executing parallel, multi-step tasks, efficiency becomes essential. Bryce predicts that smaller, task-specific models and cloud-native routing optimizations will drive major performance gains. Ultimately, he sees CNCF technologies forming the foundation for what he calls “the biggest workload mankind will ever have.”
Learn more from The New Stack about inference:
Confronting AI’s Next Big Challenge: Inference Compute
Deep Infra Is Building an AI Inference Cloud for Developers
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
From Cloud Native to AI Native: Where Are We Going?
At KubeCon + CloudNativeCon 2025 in Atlanta, the panel of experts - Kate Goldenring of Fermyon Technologies, Idit Levine of Solo.io, Shaun O'Meara of Mirantis, Sean O'Dell of Dynatrace and James Harmison of Red Hat - explored whether the cloud native era has evolved into an AI native era — and what that shift means for infrastructure, security and development practices. Jonathan Bryce of the CNCF argued that true AI-native systems depend on robust inference layers, which have been overshadowed by the hype around chatbots and agents. As organizations push AI to the edge and demand faster, more personalized experiences, Fermyon’s Kate Goldenring highlighted WebAssembly as a way to bundle and securely deploy models directly to GPU-equipped hardware, reducing latency while adding sandboxed security.
Dynatrace’s Sean O’Dell noted that AI dramatically increases observability needs: integrating LLM-based intelligence adds value but also expands the challenge of filtering massive data streams to understand user behavior. Meanwhile, Mirantis CTO Shaun O’Meara emphasized a return to deeper infrastructure awareness. Unlike abstracted cloud native workloads, AI workloads running on GPUs require careful attention to hardware performance, orchestration, and energy constraints. Managing power-hungry data centers efficiently, he argued, will be a defining challenge of the AI native era.
Learn more from The New Stack about evolving cloud native ecosystem to an AI native era
Cloud Native and AI: Why Open Source Needs Standards Like MCP
A Decade of Cloud Native: From CNCF, to the Pandemic, to AI
Crossing the AI Chasm: Lessons From the Early Days of Cloud
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.