Announcing llm-d 1.0: Open Distributed Inference for Agents on Google Cloud TPUs and GPUs
Google, Tuesday, October 20th, 2026
Google announces llm-d 1.0, an open-source Kubernetes-native stack for distributed LLM inference, released at PyTorch Conference.
Google says llm-d 1.0, an open-source, Kubernetes-native stack for distributed LLM inference, was released at PyTorch Conference.
The CNCF Sandbox project was co-founded by Google with Red Hat, IBM and others and has more than 500 contributors from over 25 organizations.
It offers cache-aware routing, multi-tenant traffic control, tiered KV cache and high availability.
Google says it is production-ready on Google Cloud TPUs and GPUs.