GitHub · #359

jundot/omlx

jundot/omlx is #359 in this GitHub directory, with 22,905 stars. LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Repository
https://github.com/jundot/omlx
Homepage
https://omlx.ai
Owner
jundot (User)
Stars
22,905
Forks
2,136
Open issues
651
Language
Python
License
Apache-2.0
Created
2026-02-13
Last push
2026-10-17
Topics
apple-silicon, inference-server, llm, macos, mlx, openai-api
Snapshot
2026-10-18

Back to the GitHub directory · Methodology