GitHub · #1091

EleutherAI/gpt-neox

EleutherAI/gpt-neox is #1091 in this GitHub directory, with 7,470 stars. An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Repository
https://github.com/EleutherAI/gpt-neox
Homepage
https://www.eleuther.ai/
Owner
EleutherAI (Organization)
Stars
7,470
Forks
1,127
Open issues
125
Language
Python
License
Apache-2.0
Created
2020-12-22
Last push
2026-10-11
Topics
deepspeed-library, gpt-3, language-model, transformers
Snapshot
2026-10-18

Back to the GitHub directory · Methodology