Hugging Face dataset · #50

uonlp/CulturaX

uonlp/CulturaX is #50 among listed Hugging Face datasets, with 704 likes. Cleaned, Enormous, and Public: The Multilingual Fuel to Democratize Large Language Models for 167 Languages Dataset Summary We present CulturaX, a substantial multilingual dataset with 6.3 trillion tokens in 167 languages, tailored for large language model (LLM) development…

Dataset
https://huggingface.co/datasets/uonlp/CulturaX
Author
uonlp (org)
Likes
704
Downloads (30 days)
25,753
License
—
Size
1B<n<10B
Tasks
text-generation, fill-mask
Modalities
text
Gated
Access requires accepting terms on Hugging Face
Created
2023-09-04
Last modified
2024-12-16
Snapshot
2026-10-21

Back to Hugging Face datasets · Methodology