GitHub · #669

LMCache/LMCache

LMCache/LMCache is #669 in this GitHub directory, with 12,108 stars. LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Repository
https://github.com/LMCache/LMCache
Homepage
https://lmcache.ai/
Owner
LMCache (Organization)
Stars
12,108
Forks
2,113
Open issues
859
Language
Python
License
Apache-2.0
Created
2024-05-28
Last push
2026-10-18
Topics
amd, cuda, fast, inference, kv-cache, llm, pytorch, rocm, speed, vllm
Snapshot
2026-10-18

Back to the GitHub directory · Methodology