- Repository
- https://github.com/Tiiny-AI/PowerInfer
- Owner
- Tiiny-AI (Organization)
- Stars
- 9,837
- Forks
- 623
- Open issues
- 133
- Language
- C++
- License
- MIT
- Created
- 2023-12-15
- Last push
- 2026-05-11
- Topics
- large-language-models, llama, llm, llm-inference, local-inference
- Snapshot
- 2026-10-18
GitHub · #832
Tiiny-AI/PowerInfer
Tiiny-AI/PowerInfer is #832 in this GitHub directory, with 9,837 stars. High-speed Large Language Model Serving for Local Deployment