GitHub · #1611

togethercomputer/RedPajama-Data

togethercomputer/RedPajama-Data is #1611 in this GitHub directory, with 4,994 stars. The RedPajama-Data repository contains code for preparing large datasets for training large language models.

Repository: https://github.com/togethercomputer/RedPajama-Data
Owner: togethercomputer (Organization)
Stars: 4,994
Forks: 374
Open issues: 43
Language: Python
License: Apache-2.0
Created: 2023-04-14
Last push: 2026-06-03
Snapshot: 2026-10-18

Back to the GitHub directory · Methodology