Text Retrieval Datasets
There are 41 text retrieval datasets in our directory, 4 of which are benchmarks. Each links to its source, paper, and download — browse the full list below or filter by language.
Text Retrieval is a machine-learning task covered in our directory. We catalog 41 datasets for it.
- ai4privacy/pii-masking-200kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-300kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-400kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- artefactory/Argimi-Ardian-Finance-10k-textText Retrieval, Text GenerationEN
- arxiv-community/arxiv_datasetTranslation, Summarization, Text RetrievalEN
- Babelscape/rebel-datasetText Retrieval, Text GenerationEN
- BeIR/nfcorpusZero Shot Classification, Text RetrievalEN
- BeIR/scifactZero Shot Classification, Text RetrievalEN
- Brianferrell787/financial-news-multisourceText Classification, Text Retrieval, OtherEN
- deepset/germanquadQuestion Answering, Text RetrievalDE
- dell-research-harvard/AmericanStoriesText Classification, Text Generation, Text Retrieval, Summarization, Question AnsweringENBenchmark
- dell-research-harvard/newswireText Classification, Text Generation, Text Retrieval, Summarization, Question AnsweringENBenchmark
- facebook/kilt_tasksFill Mask, Question Answering, Text Classification, Text Generation, Text RetrievalEN
- G4KMU/LEMURText RetrievalBG, CS, DE
- gfissore/arxiv-abstracts-2021Summarization, Text RetrievalEN
- google/witText Retrieval, Image To TextAF, AR, AST
- google/xtremeMultiple Choice, Question Answering, Token Classification, Text Classification, Text RetrievalAF, AR, BG
- ibm-research/VAKRAQuestion Answering, Text Retrieval, Text GenerationENBenchmark
- isaacus/open-australian-legal-corpusText Generation, Fill Mask, Text RetrievalEN
- jamescalam/youtube-transcriptionsQuestion Answering, Text Retrieval, Visual Question AnsweringEN
- KBlueLeaf/danbooru2023-metadata-databaseImage Classification, Text To Image, Image To Text, Image To Image, Text Retrieval, Text Generation, Text ClassificationEN, JA
- mbien/recipe_nlgText Generation, Fill Mask, Text Retrieval, SummarizationEN
- microsoft/hnm-search-dataText Ranking, Text Retrieval, Text ClassificationENBenchmark
- miracl/miraclText RetrievalAR, BN, EN
- miracl/miracl-corpusText RetrievalAR, BN, EN
- mteb/arguanaText RetrievalENG
- mteb/nfcorpusText RetrievalENG
- mteb/scifactText RetrievalENG
- NTU-NLP-sg/xCodeEvalTranslation, Token Classification, Text Retrieval, Text Generation, Text Classification, Feature Extraction, Question AnsweringCODE, EN
- nvidia/embed-nemotron-dataset-v1Text Retrieval, Text Ranking, Sentence Similarity, Text ClassificationMULTILINGUAL
- reasonir/reasonir-dataText RetrievalEN
- ronantakizawa/github-top-developersText Classification, Time Series Forecasting, Text RetrievalEN
- ruggsea/infini-news-corpusText Generation, Text Classification, Text RetrievalENG, SPA, RUS
- Shitao/MLDRText RetrievalAR, DE, EN
- tdiggelm/climate_feverText Classification, Text RetrievalEN
- THUIR/QilinQuestion Answering, Text Classification, Sentence Similarity, Text Retrieval, Image Text To TextZH
- THUIR/T2RankingText Retrieval, Text Classification, Sentence SimilarityZH
- UCSC-VLAA/Recap-DataComp-1BZero Shot Classification, Text Retrieval, Image To Text, Text To ImageEnglish
- Ujjwal-Tyagi/ai-ml-foundations-book-collectionText Generation, Text Classification, Question Answering, Summarization, Sentence Similarity, Feature Extraction, Zero Shot Classification, Text Retrieval, Token Classification, Multiple Choice, Fill MaskEN
- wikimedia/wit_baseImage To Text, Text RetrievalAF, AN, AR
- xlangai/BRIGHTText RetrievalEN