Zyphra/Zyda-2
Preview • Updated • 150k • 94
Interesting Pre-Training Datasets
Note Look at the preprocessing code: https://github.com/Zyphra/Zyda_processing
-
HuggingFaceTB/dclm-edu
Viewer • Updated • 1B • 8.35k • 31 -
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.5B • 625k • 1.09k -
HuggingFaceTB/stack-edu
Viewer • Updated • 167M • 5.94k • 70 -
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 39.9k • 360 -
bigcode/the-stack
Viewer • Updated • 546M • 19.8k • 1k -
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 18.1k • 565 -
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 61.5k • 457 -
mlfoundations/dclm-baseline-1.0
Preview • Updated • 498k • 274 -
HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 57k • 803