Multilingual Datasets
We catalog 12 Multilingual datasets for NLP and machine learning. Browse the list below or narrow down by task.
This page covers multilingual data spanning many languages at once, used to train and evaluate cross-lingual models. Our directory includes 12 datasets in Multilingual.
- anoynsharechat/sharechatText Generation, Question AnsweringEN, MULTILINGUAL
- ByteDance/MTVQAVisual Question Answering, Image To TextMULTILINGUAL, AR, DE
- jingyaogong/minimind_datasetText GenerationMULTILINGUAL
- Mearman/OpenAlexTabular Classification, Feature ExtractionEN, MULTILINGUAL
- MoritzLaurer/multilingual-NLI-26lang-2mil7Text ClassificationMULTILINGUAL, ZH, JA
- natgillin/translationsGeneral NLPMULTILINGUAL
- natgillin/translations-rawGeneral NLPMULTILINGUAL
- nvidia/embed-nemotron-dataset-v1Text Retrieval, Text Ranking, Sentence Similarity, Text ClassificationMULTILINGUAL
- nyuuzyou/sunoAudio Classification, Text To AudioEN, JA, MULTILINGUAL
- opendatalab/AICCText GenerationMULTILINGUAL
- stanford-oval/ccnewsText Classification, Question Answering, Text GenerationMULTILINGUAL, AF, AM
- stepfun-ai/Step-3.5-Flash-SFTText GenerationMULTILINGUAL