GitHub · #1655

llm-d/llm-d

llm-d/llm-d is #1655 in this GitHub directory, with 4,856 stars. Achieve state of the art inference performance with modern accelerators on Kubernetes

Repository: https://github.com/llm-d/llm-d
Homepage: https://www.llm-d.ai
Owner: llm-d (Organization)
Stars: 4,856
Forks: 858
Open issues: 100
Language: Python
License: Apache-2.0
Created: 2025-04-29
Last push: 2026-10-18
Topics: ai, cncf, distributed-inference, gpu, inference, intelligent-routing, kubernetes, llm, model-server
Snapshot: 2026-10-18

Back to the GitHub directory · Methodology