GitHub · #2324

huggingface/datatrove

huggingface/datatrove is #2324 in this GitHub directory, with 3,392 stars. Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Repository
https://github.com/huggingface/datatrove
Owner
huggingface (Organization)
Stars
3,392
Forks
318
Open issues
122
Language
Python
License
Apache-2.0
Created
2023-06-14
Last push
2026-10-06
Snapshot
2026-10-18

Back to the GitHub directory · Methodology