GitHub · #450

NVIDIA/Megatron-LM

NVIDIA/Megatron-LM is #450 in this GitHub directory, with 18,188 stars. Ongoing research training transformer models at scale

Repository: https://github.com/NVIDIA/Megatron-LM
Homepage: https://docs.nvidia.com/megatron-core/developer-guide/latest/get-started/quickstart.html
Owner: NVIDIA (Organization)
Stars: 18,188
Forks: 4,634
Open issues: 1,651
Language: Python
License: Other
Created: 2019-03-21
Last push: 2026-10-18
Topics: large-language-models, model-para, transformers
Snapshot: 2026-10-18