Summarization Datasets
There are 98 summarization datasets in our directory, 3 of which are benchmarks. Each links to its source, paper, and download — browse the full list below or filter by language.
Summarization is the task of condensing a longer document into a shorter version that retains its key points. We catalog 98 datasets for it.
- abisee/cnn_dailymailSummarizationEN
- ai-hyz/MemoryAgentBenchQuestion Answering, Zero Shot Classification, Summarization, Text Classification, Text GenerationEN
- ai4privacy/pii-masking-200kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-300kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- ai4privacy/pii-masking-400kText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text Generation, Translation, Fill Mask, Tabular Classification, Tabular To Text, Table To Text, Text Retrieval, OtherEN, FR, DE
- akoksal/LongFormTable Question Answering, Summarization, Text Generation, Question AnsweringEN
- alexfabbri/multi_newsSummarizationEN
- AlgorithmicResearchGroup/s2orc_arxivText Generation, Summarization, Feature ExtractionENBenchmark
- allenai/scitldrSummarizationEN
- Annotated Enron Subject Line Corpus (AESLC)SummarizationEnglish
- argilla/news-summarySummarizationEN
- armanc/scientific_papersSummarizationEN
- arxiv-community/arxiv_datasetTranslation, Summarization, Text RetrievalEN
- b3x0m/Chinese-H-NovelsText Classification, Summarization, Token Classification, Question Answering, Text Generation, Fill Mask, Sentence SimilarityZH
- BigPatentSummarizationEnglish
- BillSumSummarizationEnglish
- CASSSummarizationFrench
- ccdv/arxiv-summarizationSummarization, Text GenerationEN
- ccdv/cnn_dailymailSummarization, Text GenerationEN
- ccdv/govreport-summarizationSummarization, Text GenerationEN
- ccdv/pubmed-summarizationSummarization, Text GenerationEN
- ccmusic-database/acapellaAudio Classification, Table Question Answering, SummarizationZH, EN
- CohereLabs/aya_collectionText Classification, Summarization, TranslationACE, AFR, AMH
- Cornell NewsroomText Corpora, SummarizationEnglish
- CorpusTCCSummarizationPortuguese
- csebuetnlp/xlsumSummarization, Text GenerationAM, AR, AZ
- daekeun-ml/naver-news-summarization-koSummarizationKO
- DAMO-NLP-SG/multimodal_textbookText Generation, SummarizationEN
- databricks/databricks-dolly-15kQuestion Answering, SummarizationEN
- davidchan/anim400kText To Speech, Automatic Speech Recognition, Audio To Audio, Audio Classification, Text Classification, Video Classification, SummarizationEN, JA
- defunct-datasets/amazon_reviews_multiSummarization, Text Generation, Fill Mask, Text ClassificationDE, EN, ES
- defunct-datasets/amazon_us_reviewsSummarization, Text Generation, Fill Mask, Text ClassificationEN
- dell-research-harvard/AmericanStoriesText Classification, Text Generation, Text Retrieval, Summarization, Question AnsweringENBenchmark
- dell-research-harvard/newswireText Classification, Text Generation, Text Retrieval, Summarization, Question AnsweringENBenchmark
- dennlinger/eur-lex-sumTranslation, SummarizationBG, HR, CS
- EdinburghNLP/xsumSummarizationEN
- esdurmus/wiki_linguaSummarizationAR, CS, DE
- Essex Arabic Summaries Corpus (EASC)SummarizationArabic
- euirim/goodwikiText Generation, SummarizationEN
- FBK-MT/MCIFAutomatic Speech Recognition, Question Answering, Summarization, Visual Question Answering, TranslationEN, DE, IT
- FiscalNote/billsumSummarizationEN
- flytech/python-codes-25kText Classification, Question Answering, Token Classification, Summarization, Text GenerationEnglish
- FraunhoferIPK/IndEgoVisual Question Answering, Summarization, Video Classification, Any To AnyEN, DE
- gajeshladhar/core-fiveImage Segmentation, Image Classification, Object Detection, Image To Text, Image To Image, Translation, Summarization, Feature Extraction, Unconditional Image GenerationEN
- GEM/gemFill Mask, Summarization, Table To Text, Tabular To Text, Text GenerationCS, DE, EN
- GEM/wiki_linguaSummarizationAR, CS, DE
- gfissore/arxiv-abstracts-2021Summarization, Text RetrievalEN
- GigawordSummarizationEnglish
- HackerNoon/tech-company-news-data-dumpText Classification, SummarizationEN
- hltcoe/megawikaSummarization, Question Answering, Text GenerationAF, AR, AZ
- hollyyfc/tidytuesday_for_pythonSummarization, Feature Extraction, Text ClassificationEN
- How2Speech-to-Text, Translation, Summarization, VisualPortuguese, English
- HUPD/hupdFill Mask, Summarization, Text Classification, Token ClassificationEN
- huuuyeah/meetingbankSummarization, Text GenerationEN
- IndoSumSummarizationIndonesian
- Johnnyeee/Yelpdata_663SummarizationEN
- KALIMAT Multipurpose Arabic CorpusSummarization, Named Entity Recognition (NER), Part-of-Speech (POS)Arabic
- knkarthick/dialogsumSummarization, Text GenerationEN
- knkarthick/samsumSummarizationEN
- kyujinpy/OpenOrca-KOText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text GenerationKO
- LCSTSSummarizationChinese
- M-A-D/Mixed-Arabic-Datasets-RepoText Classification, Question Answering, Translation, Summarization, Text Generation, Fill MaskAR
- MATINFClassification, Question Answering, SummarizationChinese
- mbien/recipe_nlgText Generation, Fill Mask, Text Retrieval, SummarizationEN
- MEDIQA-Answer SummarizationSummarizationEnglish
- MLSUMSummarizationMulti-Lingual
- Multi-NewsSummarizationEnglish
- Multi-XscienceSummarizationEnglish
- MultiLing Pilot 2011 DatasetSummarizationMulti-Lingual
- NewSHeadSummarization, Headline GenerationEnglish
- nlpai-lab/databricks-dolly-15k-koQuestion Answering, SummarizationKO
- NortheasternUniversity/big_patentSummarizationEN
- Open-Orca/OpenOrcaText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text GenerationEN
- Open-Orca/SlimOrcaText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text GenerationEN
- OpinosisSummarizationEnglish
- PleIAs/SYNTHText Generation, Zero Shot Classification, SummarizationEN, FR, IT
- Polish Summaries Corpus (PSC)SummarizationPolish
- reciTAL/mlsumSummarization, Translation, Text ClassificationDE, ES, FR
- RUC-NLPIR/FlashRAG_datasetsQuestion Answering, SummarizationEN
- Salesforce/dialogstudioQuestion Answering, Summarization, Text Generation, Table To Text, Text Classification, Table Question AnsweringEN
- SAMSumSummarizationEnglish
- SCITLDRSummarizationEnglish
- squarelike/OpenOrca-gugugo-koText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text GenerationKO
- starmpcc/Asclepius-Synthetic-Clinical-NotesQuestion Answering, Summarization, Text GenerationEN
- Targoman/TLPCQuestion Answering, Text Classification, Translation, Summarization, Text GenerationFA
- th1nhng0/vietnamese-legal-documentsText Classification, Text Generation, Question Answering, SummarizationVI
- The New York Times Annotated CorpusSummarization, Information ExtractionEnglish
- Ujjwal-Tyagi/ai-ml-foundations-book-collectionText Generation, Text Classification, Question Answering, Summarization, Sentence Similarity, Feature Extraction, Zero Shot Classification, Text Retrieval, Token Classification, Multiple Choice, Fill MaskEN
- voilaj/swiss-caselawText Classification, Summarization, Question AnsweringDE, FR, IT
- Webis-Snippet-20 CorpusSummarizationEnglish
- Webis-TLDR-17 CorpusSummarizationEnglish
- webis/tldr-17SummarizationEN
- WikiHowText Corpora, SummarizationEnglish
- Wikipedia Current Events Portal (WCEP) DatasetSummarizationEnglish
- WikiSummarySummarizationPersian
- X-SumSummarizationEnglish
- yys/OpenOrca-ChineseText Classification, Token Classification, Table Question Answering, Question Answering, Zero Shot Classification, Summarization, Feature Extraction, Text GenerationZH
- zai-org/LongBenchQuestion Answering, Text Generation, Summarization, Text ClassificationEN, ZH
What languages do summarization datasets cover?
EN datasets (50)English datasets (20)DE datasets (11)FR datasets (6)AR datasets (5)ZH datasets (4)KO datasets (4)CS datasets (4)IT datasets (3)Portuguese datasets (2)AZ datasets (2)ES datasets (2)Arabic datasets (2)Chinese datasets (2)Multi-Lingual datasets (2)French datasets (1)ACE datasets (1)AFR datasets (1)