- Dataset
- https://huggingface.co/datasets/mlfoundations/dclm-baseline-1.0
- Author
- mlfoundations (org)
- Likes
- 328
- Downloads (30 days)
- 436,635
- License
- cc-by-4.0
- Size
- 1B<n<10B
- Tasks
- —
- Modalities
- tabular, text
- Gated
- No
- Created
- 2024-06-17
- Last modified
- 2024-07-22
- Snapshot
- 2026-10-21
Hugging Face dataset · #177
mlfoundations/dclm-baseline-1.0
mlfoundations/dclm-baseline-1.0 is #177 among listed Hugging Face datasets, with 328 likes. DCLM-baseline is a 4T token / 3B document pretraining dataset that achieves strong performance on language model benchmarks. Below are comparisions of model trained on DCLM-baseline with other models in the 7B regime. Model Params Tokens Open dataset? CORE MMLU EXTENDED Open…