Multiple Choice Datasets
There are 33 multiple choice datasets in our directory, 9 of which are benchmarks. Each links to its source, paper, and download — browse the full list below or filter by language.
Multiple Choice is the task of selecting the correct answer from a fixed set of candidate options. We catalog 33 datasets for it.
- AI4Math/MathVerseMultiple Choice, Question Answering, Visual Question AnsweringEN
- AI4Math/MathVistaMultiple Choice, Question Answering, Visual Question Answering, Text ClassificationEN, ZH, FA
- allenai/cosmos_qaMultiple ChoiceEN
- Anthropic/model-written-evalsMultiple Choice, Zero Shot Classification, Question AnsweringEN
- ceval/ceval-examText Classification, Multiple Choice, Question AnsweringZH
- clue/clueText Classification, Multiple ChoiceZH
- CohereLabs/include-base-44Multiple ChoiceSQ, AR, HY
- demelin/moral_storiesMultiple Choice, Text Generation, Text ClassificationEN
- derek-thomas/ScienceQAMultiple Choice, Question Answering, Other, Visual Question Answering, Text ClassificationEN
- ehovy/raceMultiple ChoiceEN
- facebook/belebeleQuestion Answering, Zero Shot Classification, Text Classification, Multiple ChoiceAF, AM, AR
- google/bigbenchMultiple Choice, Question Answering, Text Classification, Text Generation, Zero Shot Classification, OtherENBenchmark
- google/RSRCCVisual Question Answering, Image Text To Text, Multiple ChoiceEN
- google/xtremeMultiple Choice, Question Answering, Token Classification, Text Classification, Text RetrievalAF, AR, BG
- HAERAE-HUB/KMMLUMultiple ChoiceKOBenchmark
- jmhessel/newyorker_caption_contestImage To Text, Multiple Choice, Text Classification, Text Generation, Visual Question Answering, OtherEN
- Lin-Chen/MMStarMultiple Choice, Question Answering, Visual Question AnsweringEN
- lmlmcat/cmmluMultiple Choice, Question AnsweringZHBenchmark
- longvideobench/LongVideoBenchMultiple Choice, Visual Question AnsweringEN
- maritaca-ai/enemVisual Question Answering, Multiple ChoicePT
- MathLLMs/MathVisionQuestion Answering, Multiple Choice, Visual Question Answering, Text Generation, Image To Text, Image Text To TextEN
- MathLLMs/VoiceAssistant-EvalQuestion Answering, Visual Question Answering, Audio To Audio, Any To Any, Multiple Choice, Text GenerationEnglish
- MMMU/MMMUQuestion Answering, Visual Question Answering, Multiple ChoiceENBenchmark
- MMMU/MMMU_ProQuestion Answering, Visual Question Answering, Multiple ChoiceENBenchmark
- mrlbenchmarks/global-piqa-nonparallelQuestion Answering, Multiple ChoiceACM, ACQ, AEBBenchmark
- openlifescienceai/medmcqaQuestion Answering, Multiple ChoiceEN
- ReasonCore/open-spatial-reasoningMultiple ChoiceEN
- shunk031/JGLUEMultiple Choice, Question Answering, Sentence Similarity, Text ClassificationJA
- tasksource/bigbenchMultiple Choice, Question Answering, Text Classification, Text Generation, Zero Shot ClassificationENBenchmark
- tasksource/mmluText Classification, Multiple Choice, Question AnsweringENBenchmark
- truthfulqa/truthful_qaMultiple Choice, Text Generation, Question AnsweringENBenchmark
- Ujjwal-Tyagi/ai-ml-foundations-book-collectionText Generation, Text Classification, Question Answering, Summarization, Sentence Similarity, Feature Extraction, Zero Shot Classification, Text Retrieval, Token Classification, Multiple Choice, Fill MaskEN
- zai-org/LongBench-v2Multiple Choice, Question Answering, Text Classification, Table Question AnsweringEN