HuggingFaceFW/finepdfs_edu_classifier_hun_Latn
0.3B • Updated • 12
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
Papers
How Can We Synthesize High-Quality Pretraining Data? A Systematic Study of Prompt Design, Generator Model, and Source Data
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
HuggingFaceFW/finepdfs_edu_classifier_swe_Latn
0.3B • Updated • 15
HuggingFaceFW/finepdfs_edu_classifier_ron_Latn
0.3B • Updated • 7
HuggingFaceFW/finepdfs_edu_classifier_cmn_Hani
0.3B • Updated • 19
HuggingFaceFW/finepdfs_edu_classifier_ces_Latn
0.3B • Updated • 17
HuggingFaceFW/finepdfs_edu_classifier_nld_Latn
0.3B • Updated • 11
HuggingFaceFW/finepdfs_edu_classifier_pol_Latn
0.3B • Updated • 13
HuggingFaceFW/finepdfs_edu_classifier_por_Latn
0.3B • Updated • 17 • 1
HuggingFaceFW/finepdfs_edu_classifier_unknown
0.3B • Updated • 13
HuggingFaceFW/finepdfs_edu_classifier_rus_Cyrl
0.3B • Updated • 12
HuggingFaceFW/finepdfs_edu_classifier_ita_Latn
0.3B • Updated • 7 • 1
HuggingFaceFW/finepdfs_edu_classifier_spa_Latn
0.3B • Updated • 13
HuggingFaceFW/finepdfs_edu_classifier_fra_Latn
0.3B • Updated • 7
HuggingFaceFW/finepdfs_edu_classifier_jpn_Jpan
0.3B • Updated • 17
HuggingFaceFW/finepdfs_edu_classifier_deu_Latn
0.3B • Updated • 8
HuggingFaceFW/fineweb-edu-classifier
Text Classification • 0.1B • Updated • 10.6k • • 230
HuggingFaceFW/Datasets-Metrics-Viewer-Data
Updated
HuggingFaceFW/ablation-model-fineweb-edu
Text Generation • 2B • Updated • 944 • 24
HuggingFaceFW/ablation-exp-filter-custom-all_filters-28BT
Text Generation • 2B • Updated • 12 • 1
HuggingFaceFW/ablation-exp-filter-custom-line_char_duplicated_0.01-28BT
Text Generation • 2B • Updated • 11 • 2
HuggingFaceFW/ablation-exp-filter-custom-line_ratio_0.67-28BT
Text Generation • 2B • Updated • 13
HuggingFaceFW/ablation-exp-filter-custom-lines_punct_0.12-28BT
Text Generation • 2B • Updated • 14 • 3
HuggingFaceFW/ablation-exp-filter-baseline_c4-28BT
Text Generation • 2B • Updated • 18 • 2
HuggingFaceFW/ablation-exp-filter-baseline_cc-28BT
Text Generation • 2B • Updated • 10 • 4
HuggingFaceFW/ablation-exp-filter-c4-word_lengths-28BT
Text Generation • 2B • Updated • 15 • 2
HuggingFaceFW/ablation-exp-filter-c4-tpunct-28BT
Text Generation • 2B • Updated • 17 • 1
HuggingFaceFW/ablation-exp-filter-c4-curly_bracket-28BT
Text Generation • 2B • Updated • 9
HuggingFaceFW/ablation-exp-filter-c4-all-28BT
Text Generation • 2B • Updated • 9
HuggingFaceFW/ablation-exp-filter-c4-all_except_tpunct-28BT
Text Generation • 2B • Updated • 12
HuggingFaceFW/ablation-exp-textext-wet-28BT
Text Generation • 2B • Updated • 13