Hugging Face dataset · #53

allenai/c4

allenai/c4 is #53 among listed Hugging Face datasets, with 684 likes. A colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: ' This is the processed version of Google's C4 dataset We prepared five variants of the data: en, en.noclean, en.noblocklist, realnewslike, and multilingual (mC4). For reference…

Dataset
https://huggingface.co/datasets/allenai/c4
Author
allenai (org)
Likes
684
Downloads (30 days)
748,987
License
odc-by
Size
10B<n<100B
Tasks
text-generation, fill-mask
Modalities
text
Gated
No
Created
2022-03-02
Last modified
2024-01-09
Snapshot
2026-10-21

Back to Hugging Face datasets · Methodology