GitHub · #645

bentoml/OpenLLM

bentoml/OpenLLM is #645 in this GitHub directory, with 12,559 stars. Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Repository
https://github.com/bentoml/OpenLLM
Homepage
https://bentoml.com
Owner
bentoml (Organization)
Stars
12,559
Forks
947
Open issues
21
Language
Python
License
Apache-2.0
Created
2023-04-19
Last push
2026-10-12
Topics
bentoml, fine-tuning, llama, llama2, llama3-1, llama3-2, llama3-2-vision, llm, llm-inference, llm-ops, llm-serving, llmops
Snapshot
2026-10-18

Back to the GitHub directory · Methodology