GitHub · #922

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more! On Linux: git clone, python3 -m venv .venv, then pip install -e . 8,906 GitHub stars (#922 in this directory).

Repository
https://github.com/bentoml/BentoML
Homepage
https://bentoml.com
Owner
bentoml (Organization)
Stars
8,906
Forks
1,045
Open issues
235
Language
Python
License
Apache-2.0
Created
2019-04-02
Last push
2026-10-05
Topics
ai-inference, deep-learning, generative-ai, inference-platform, llm, llm-inference, llm-serving, llmops, machine-learning, ml-engineering, mlops, model-inference-service
Snapshot
2026-10-18 · weekly refresh

Try it on Shadowfetch Linux.

Shadowfetch Linux is a Debian testing desktop with KDE Plasma, local AI tools, and ShadowCode. Clone this repository there, follow the steps for its primary language, and ask ShadowCode to finish the build.

Clone and set up a Python environment.

git clone https://github.com/bentoml/BentoML.git
cd BentoML
python3 -m venv .venv
source .venv/bin/activate
pip install -e .

If the project has no installable package, use the README’s requirements file or conda notes instead of pip install -e .

ShadowCode prompt.

Paste this into ShadowCode after you open the project.

Clone https://github.com/bentoml/BentoML into ~/Workspaces/BentoML.
Read the README.
On this Shadowfetch Linux desktop, create a Python virtualenv, install from the README, then run or import the project.
Ask before installing packages or using the network.

Download Shadowfetch Linux — ISO, checksum and signature.

Back to the GitHub directory · Methodology