GitHub · #412

kvcache-ai/ktransformers

kvcache-ai/ktransformers is #412 in this GitHub directory, with 19,614 stars. A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Repository
https://github.com/kvcache-ai/ktransformers
Homepage
https://kvcache-ai.github.io/ktransformers/
Owner
kvcache-ai (Organization)
Stars
19,614
Forks
1,603
Open issues
525
Language
Python
License
Apache-2.0
Created
2024-07-26
Last push
2026-10-16
Snapshot
2026-10-18

Back to the GitHub directory · Methodology