Fill Mask Datasets
There are 70 fill mask datasets in our directory, 1 of which are benchmarks. Each links to its source, paper, and download — browse the full list below or filter by language.
Fill Mask is the task of predicting masked-out words in a sentence, the pre-training objective behind models like BERT. We catalog 70 datasets for it.
- abuelkhair-corpus/arabic_billion_wordsText Generation, Fill MaskAR
- ai4privacy/pii-masking-200kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-300kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-400kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- allenai/c4Text Generation, Fill MaskAF, AM, AR
- allenai/peS2oText Generation, Fill MaskEN
- allenai/quacQuestion Answering, Text Generation, Fill MaskEN
- AmazonScience/FalseRejectText Generation, Fill MaskEN
- b3x0m/Chinese-H-NovelsText Classification, Summarization, Token Classification, Question Answering, Text Generation, Fill Mask, Sentence SimilarityZH
- bookcorpus/bookcorpusText Generation, Fill MaskEN
- code-search-net/code_search_netText Generation, Fill MaskCODEBenchmark
- defunct-datasets/amazon_reviews_multiSummarization, Text Generation, Fill Mask, Text ClassificationDE, EN, ES
- defunct-datasets/amazon_us_reviewsSummarization, Text Generation, Fill Mask, Text ClassificationEN
- defunct-datasets/bookcorpusopenText Generation, Fill MaskEN
- defunct-datasets/the_pile_books3Text Generation, Fill MaskEN
- EleutherAI/pileText Generation, Fill MaskEN
- facebook/kilt_tasksFill Mask, Question Answering, Text Classification, Text Generation, Text RetrievalEN
- facebook/wiki_dprFill Mask, Text GenerationEN
- GEM/gemFill Mask, Summarization, Table To Text, Tabular To Text, Text GenerationCS, DE, EN
- graelo/wikipediaText Generation, Fill MaskAB, ACE, ADY
- gretelai/synthetic_pii_finance_multilingualText Classification, Fill Mask, Token ClassificationEN, FR, DE
- HPLT/HPLT2.0_cleanedFill Mask, Text GenerationACE, AF, ALS
- HUPD/hupdFill Mask, Summarization, Text Classification, Token ClassificationEN
- isaacus/open-australian-legal-corpusText Generation, Fill Mask, Text RetrievalEN
- JanosAudran/financial-reports-secFill Mask, Text ClassificationEN
- JeanKaddour/minipileText Generation, Fill MaskEN
- jhu-clsp/ettin-pretraining-dataText Generation, Fill Mask, Text ClassificationEN
- jhu-clsp/mmBERT-decay-dataFill MaskEnglish
- jobs-git/HPLT2.0_cleanedFill Mask, Text GenerationACE, AF, ALS
- joelniklaus/Multi_Legal_PileFill MaskBG, CS, DA
- joelniklaus/MultiLegalPile_Wikipedia_FilteredFill MaskBG, CS, DA
- Jr23xd23/ArabicText-LargeText Generation, Fill Mask, Text ClassificationAR
- klue/klueFill Mask, Question Answering, Text Classification, Text Generation, Token ClassificationKO
- legacy-datasets/c4Text Generation, Fill MaskEN
- legacy-datasets/mc4Text Generation, Fill MaskAF, AM, AR
- legacy-datasets/wikipediaText Generation, Fill MaskAA, AB, ACE
- liwu/MNBVCText Generation, Fill MaskZH
- Locutusque/UltraTextbooks-2.0Text Generation, Text Classification, Fill MaskEN
- M-A-D/Mixed-Arabic-Datasets-RepoText Classification, Question Answering, Translation, Summarization, Text Generation, Fill MaskAR
- mbien/recipe_nlgText Generation, Fill Mask, Text Retrieval, SummarizationEN
- mii-llm/gazzetta-ufficialeText Generation, Fill MaskIT
- ncbi/pubmedText Generation, Fill Mask, Text ClassificationEN
- olm/wikipediaText Generation, Fill MaskAA, AB, ACE
- orionweller/mmBERT-data-midtrainingFill MaskEnglish
- orionweller/mmBERT-pretraining-data-chunk0Fill MaskEnglish
- orionweller/mmBERT-pretraining-data-chunk1Fill MaskEnglish
- orionweller/mmBERT-pretraining-data-chunk2Fill MaskEnglish
- orionweller/mmBERT-pretraining-data-chunk3Fill MaskEnglish
- oscar-corpus/colossal-oscar-1.0Fill Mask, Text GenerationEnglish
- oscar-corpus/community-oscarFill Mask, Text GenerationEnglish
- oscar-corpus/oscarText Generation, Fill MaskAF, ALS, AM
- oscar-corpus/OSCAR-2201Fill Mask, Text GenerationAF, SQ, AM
- oscar-corpus/OSCAR-2301Fill Mask, Text GenerationEnglish
- pfb30/multi_woz_v22Text Generation, Fill Mask, Token Classification, Text ClassificationEN
- pile-of-law/pile-of-lawFill MaskEN
- proj-persona/PersonaHubText Generation, Text Classification, Token Classification, Fill Mask, Table Question AnsweringEN, ZH
- ptb-text-only/ptb_text_onlyText Generation, Fill MaskEN
- rubend18/ChatGPT-Jailbreak-PromptsQuestion Answering, Text Generation, Fill Mask, Zero Shot Classification, Table Question AnsweringEN, AA
- Salesforce/wikitextText Generation, Fill MaskEN
- Skylion007/openwebtextText Generation, Fill MaskEN
- SLPL/naabFill Mask, Text GenerationFA
- statmt/cc100Text Generation, Fill MaskAF, AM, AR
- TheBritishLibrary/blbooksText Generation, Fill Mask, OtherDE, EN, ES
- Ujjwal-Tyagi/ai-ml-foundations-book-collectionText Generation, Text Classification, Question Answering, Summarization, Sentence Similarity, Feature Extraction, Zero Shot Classification, Text Retrieval, Token Classification, Multiple Choice, Fill MaskEN
- uonlp/CulturaXText Generation, Fill MaskAF, ALS, AM
- vblagoje/cc_newsText Generation, Fill MaskEN
- Viet-Mistral/CulturaYText Generation, Fill MaskAF, AR, AZ
- wikimedia/wikipediaText Generation, Fill MaskAB, ACE, ADY
- wikimedia/wikisourceText Generation, Fill MaskAR, AS, AZ
- xianbao/MNBVCText Generation, Fill MaskZH