GitHub · #768

bigscience-workshop/petals

bigscience-workshop/petals is #768 in this GitHub directory, with 10,639 stars. 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Repository
https://github.com/bigscience-workshop/petals
Homepage
https://petals.dev
Owner
bigscience-workshop (Organization)
Stars
10,639
Forks
651
Open issues
114
Language
Python
License
MIT
Created
2022-06-12
Last push
2024-09-07
Topics
bloom, chatbot, deep-learning, distributed-systems, falcon, gpt, guanaco, language-models, large-language-models, llama, machine-learning, mixtral
Snapshot
2026-10-18

Back to the GitHub directory · Methodology