Skip to content
Metatext
Sign Up

Language Modeling Datasets

There are 3 language modeling datasets in our directory. Each links to its source, paper, and download — browse the full list below or filter by language.

Language Modeling is the task of predicting the next token in a sequence — the core pre-training objective behind every LLM. We catalog 3 datasets for it.

Updated June 2026

What languages do language modeling datasets cover?

English datasets (3)

Explore other dataset tasks

General NLP(297)Text Corpora(154)Text Generation(137)Question Answering(130)Classification(45)Reading Comprehension(43)Text Classification(33)Machine Translation(25)Sentiment Analysis(21)Dialogue(21)Visual Question Answering(21)Text To Image(20)

Frequently asked questions