Microsoft wants to make service mesh invisible
At KubeCon EU 2026, Mitch Connors of Microsoft outlined a vision to make service meshes effectively invisible to users. Now working on Azure Kubernetes Application Network, a fully managed service built on Istio’s ambient mode, Connors aims to deliver core capabilities like mTLS without requiring users to engage with the complexity traditionally associated with service meshes. Ambient mode eliminates sidecar upgrade challenges by shifting functionality to node-level and waypoint proxies, though adoption still faces hurdles, including lagging CVE patching.
Connors emphasized that AI workloads are reshaping network demands, as request variability in large language models requires smarter routing and resource management. Istio is addressing this through a two-speed model: stable APIs for reliability and experimental integrations like Agent Gateway for emerging AI protocols. Features such as inference-aware routing and policy enforcement for approved LLM endpoints highlight the mesh’s growing role in AI governance.
With multi-cluster support and GPU scarcity driving workload mobility, Microsoft’s approach bets that simplifying and abstracting the mesh will broaden adoption while meeting the evolving needs of AI-driven systems.
Learn more from The New Stack about service meshes:
The Hidden Costs of Service Meshes
All the Things a Service Mesh Can Do
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
IstioCon, with Mitch Connors
Big week for Istio! Craig talks to Mitch Connors, Istio user experience working group lead and IstioCon program committee co-chair, about the project and the conference. Mitch talks to Craig about the news that Istio has been proposed to the CNCF.
Do you have something cool to share? Some questions? Let us know:
web: kubernetespodcast.com
mail: kubernetespodcast@google.com
twitter: @kubernetespod
Chatter of the week 40th anniversary of the ZX Spectrum
Some soothing YouTube channels: Adrian's Digital Basement
Jan Beta
RMC - The Cave
Mark Fixes Stuff
Some conference talks about the Commodore 64: Rich Code for Tiny Computers
DevOps for the Commodore 64
DevOps for the ZX Spectrum
Manic Miner Play online
News of the week Istio has applied to join the CNCF
Istio mode in Tanzu Service Mesh
KubeVirt moves to Incubation phase in CNCF
New sandbox projects: OpenFunction, from Kubesphere
Teller, from Spectral Ops
Sealer, from Alibaba
Chainguard Enforce Episode 47, with Kim Lewandowski
EKS Blueprints
Unit 42 finds serious vulnerabilities in AWS log4shell hotfix
Tanzu State of Kubernetes report
Go article in the Communications of the ACM
Please support DevOpsDays Kyiv
Links from the interview Istio What is Istio?
ServiceMeshCon 2019
F5 Networks
Merkle tree Merkel tree
Sparse Merkle tree
When was the last time you implemented a linked list?
Envoy proxy
istioctl wait
Istio working groups
Sidecar containers proposal
Anthos Service Mesh Managed control and data plane
IstioCon 2022 Mitch and Lin's keynote
Istio has applied to join the CNCF Pull request to the CNCF TOC
Prusa i3 The frankenprinter
RepRap
Mitch Connors on GitHub Mitch Conner from South Park
Mitch Connors on Twitter