HuggingFaceFW/fineweb-2
Viewer • Updated • 4.48B • 62.1k • 812
Edit Datasets filters
English
French
Chinese
French
Spanish
Russian
Japanese
German
Arabic
Korean
Portuguese
English
Italian
Vietnamese
Turkish
Hindi
Indonesian
Dutch
Polish
Bengali
Thai
Persian
Czech
Tamil
Swedish
Romanian
Ukrainian
Danish
Greek
Finnish
Catalan
Telugu
Hungarian
Spanish
Urdu
German
Swahili
Bulgarian
Marathi
Hebrew
Estonian
Malayalam
Basque
Slovak
Slovenian
Gujarati
Lithuanian
Croatian
Malay
Kannada
Latvian
Serbian
code
Panjabi
Amharic
Italian
Nepali
Kazakh
Norwegian
Burmese
Uzbek
Indonesian
Azerbaijani
Portuguese
Oriya
Yoruba
Hausa
Afrikaans
Sinhala
Icelandic
multilingual
Galician
Russian
Irish
Assamese
Khmer
Breton
Belarusian
Latin
Georgian
Maltese
Tagalog
Welsh
Vietnamese
Macedonian
Dutch
Armenian
Igbo
Albanian
Polish
Active filters: ilo
openlanguagedata/flores_plus
Viewer • Updated • 883k • 17.1k • 142
omarkamali/wikipedia-monthly
Viewer • Updated • 195M • 11.7k • 70
oscar-corpus/OSCAR-2201
Updated • 54.3k • 131
Muennighoff/flores200
Updated • 2.76k • 22
CohereLabs/xP3x
Viewer • Updated • 434M • 262k • 95
ayymen/Pontoon-Translations
Viewer • Updated • 3.56M • 1.7k • 19
HPLT/HPLT2.0_cleaned
Viewer • Updated • 9.03B • 52.8k • 43
facebook/bouquet
Updated • 2.37k • 40
HPLT/HPLT3.0
Updated • 88 • 20
HuggingFaceFW/finetranslations
Viewer • Updated • 3.33B • 10.6k • 292
open-index/open-wikipedia-markdown
Updated • 5.67k • 14
mrlbenchmarks/global-piqa-parallel
Viewer • Updated • 13.4k • 2.02k • 10
Reubencf/Adaption-multilingual-sentences
Viewer • Updated • 10k • 49 • 1
neurlang/ipa-lexicon-4v0-7M
Viewer • Updated • 6.91M • 472 • 5
legacy-datasets/wikipedia
Updated • 107k • 636
wikimedia/wikipedia
Viewer • Updated • 61.6M • 247k • 1.24k
facebook/flores
Viewer • Updated • 1.23M • 15.3k • 103
uonlp/CulturaX
Viewer • Updated • 7.18B • 24.1k • 632
HuggingFaceFW/finepdfs
Viewer • Updated • 476M • 63.4k • 872
oscar-corpus/oscar
Updated • 667 • 207
Helsinki-NLP/tatoeba
Updated • 3.39k • 56
community-datasets/udhr
Updated • 159 • 2
unimelb-nlp/wikiann
Viewer • Updated • 2M • 40.3k • 121
MartinThoma/wili_2018
Viewer • Updated • 235k • 494 • 5
oscar-corpus/OSCAR-2109
Updated • 77 • 42
sil-ai/bloom-lm
Updated • 26 • 29
yhavinga/ccmatrix
Updated • 1.4k • 26
bible-nlp/biblenlp-corpus
Updated • 372 • 40
sil-ai/bloom-captioning
Updated • 56 • 12