- Repository
- https://github.com/xorbitsai/inference
- Homepage
- https://inference.readthedocs.io
- Owner
- xorbitsai (Organization)
- Stars
- 9,616
- Forks
- 884
- Open issues
- 31
- Language
- Python
- License
- Apache-2.0
- Created
- 2023-06-14
- Last push
- 2026-10-18
- Topics
- artificial-intelligence, diffusers, gemma, glm, glm-5-3, inference, kimi, kimi-k3, llama-cpp, llamacpp, llm, machine-learning
- Snapshot
- 2026-10-18
GitHub · #851
xorbitsai/inference
xorbitsai/inference is #851 in this GitHub directory, with 9,616 stars. Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.