Visual Question Answering Datasets
There are 130 visual question answering datasets in our directory, 4 of which are benchmarks. Each links to its source, paper, and download — browse the full list below or filter by language.
Visual Question Answering is the task of answering natural-language questions about the contents of an image. We catalog 130 datasets for it.
- 5CD-AI/Viet-LAION-Gemini-VQAVisual Question AnsweringVI
- 7zkk/PanoEnvVisual Question Answering, Image Text To TextEN
- AI4Math/MathVerseMultiple Choice, Question Answering, Visual Question AnsweringEN
- AI4Math/MathVistaMultiple Choice, Question Answering, Visual Question Answering, Text ClassificationEN, ZH, FA
- Alfaxad/vector-100kVisual Question Answering, Text GenerationEN
- alibaba-multimodal-industrial-ai/IndustryBench-MIPUImage To Text, Visual Question AnsweringZH
- allenai/CoSyn-400KVisual Question AnsweringEnglish
- allenai/pixmo-docsVisual Question AnsweringEnglish
- AmazonScience/document-haystackQuestion Answering, Visual Question Answering, Document Question AnsweringEN
- anaisleila/computer-use-data-psaiReinforcement Learning, Robotics, Video Classification, Image To Text, Visual Question Answering, OtherEN
- BAAI/DenseFusion-1MQuestion Answering, Visual Question AnsweringEN
- BAAI/SVITVisual Question AnsweringEN
- BoKelvin/SLAKEVisual Question AnsweringEN, ZH
- BUAADreamer/llava-en-zh-300kText Generation, Visual Question AnsweringEN, ZH
- ByteDance/MTVQAVisual Question Answering, Image To TextMULTILINGUAL, AR, DE
- ChartGalaxy/ChartGalaxyVisual Question AnsweringEN
- Cognitive-Lab/NayanaOCR_Corpus_2025Image To Text, Visual Question Answering, Image Text To TextAR, BN, DE
- derek-thomas/ScienceQAMultiple Choice, Question Answering, Other, Visual Question Answering, Text ClassificationEN
- Eioss/CC-OCR-V2Image To Text, Visual Question Answering, Document Question AnsweringEN, ZH
- facebook/textvqaVisual Question AnsweringEN
- FBK-MT/MCIFAutomatic Speech Recognition, Question Answering, Summarization, Visual Question Answering, TranslationEN, DE, IT
- FigureQAVisual Question AnsweringEnglish
- flaviagiammarino/path-vqaVisual Question AnsweringEN
- flaviagiammarino/vqa-radVisual Question AnsweringEN
- Forithmus/MR-RATEImage To Text, Text To Image, Image Classification, Question Answering, Visual Question Answering, Zero Shot ClassificationEN
- Forithmus/MR-RATE-atlasImage To Text, Text To Image, Image Classification, Question Answering, Visual Question Answering, Zero Shot ClassificationEN
- Forithmus/MR-RATE-coregImage To Text, Text To Image, Image Classification, Question Answering, Visual Question Answering, Zero Shot ClassificationEN
- Forithmus/MR-RATE-nvseg-ctmrImage To Text, Text To Image, Image Classification, Question Answering, Visual Question Answering, Zero Shot ClassificationEN
- FraunhoferIPK/IndEgoVisual Question Answering, Summarization, Video Classification, Any To AnyEN, DE
- google/MapTraceImage To Text, Visual Question AnsweringEN
- google/RSRCCVisual Question Answering, Image Text To Text, Multiple ChoiceEN
- hiyouga/geometry3kVisual Question AnsweringEN
- Hothan/OlympiadBenchQuestion Answering, Visual Question AnsweringZH, EN
- HuggingFaceFV/finevideoVisual Question Answering, Video Text To TextEN
- HuggingFaceM4/DoclingMatixVisual Question Answering, Image Text To TextEN
- HuggingFaceM4/DocmatixVisual Question AnsweringEN
- ibm-granite/ChartNetImage To Text, Visual Question Answering, Table Question Answering, Text GenerationEnglish
- ibrahimhamamci/CT-RATEImage To Text, Text To Image, Image Classification, Question Answering, Visual Question Answering, Zero Shot ClassificationEN
- internlm/WildClawBenchVisual Question Answering, Image Text To Text, Question AnsweringEN, ZH
- jackluoluo/ArchCADVisual Question Answering, Image To TextEnglishBenchmark
- jamescalam/youtube-transcriptionsQuestion Answering, Text Retrieval, Visual Question AnsweringEN
- jdopensource/JoyAI-Image-OpenSpatialVisual Question Answering, Image To TextEN
- jerrychi/FinErvaImage Text To Text, Visual Question Answering, RoboticsEN
- jingyaogong/minimind-v_datasetVisual Question AnsweringZH, EN
- JingyuSun/counterfactual-vlm-benchmark-dataVisual Question AnsweringEnglish
- jinlong17/CTVid-BenchVisual Question Answering, Video ClassificationZH, EN
- jmhessel/newyorker_caption_contestImage To Text, Multiple Choice, Text Classification, Text Generation, Visual Question Answering, OtherEN
- Kondapally/AIWD6Image Classification, Object Detection, Image Segmentation, Visual Question Answering, Image To TextEnglish
- laolao77/MMDUVisual Question Answering, Question AnsweringEN
- LeoFan01/RoboBenchRobotics, Visual Question AnsweringEN
- leosltl/Android-in-the-WildImage Classification, Visual Question AnsweringEnglish
- Lin-Chen/MMStarMultiple Choice, Question Answering, Visual Question AnsweringEN
- Lin-Chen/ShareGPT4VVisual Question Answering, Question AnsweringEN
- linxir226/SurgRSImage Segmentation, Visual Question AnsweringEN
- liuhaotian/LLaVA-Instruct-150KVisual Question Answering, Question AnsweringEN
- LLaVA-VL/llava-plus-dataVisual Question Answering, Question AnsweringEN
- lmarena-ai/VisionArena-ChatVisual Question AnsweringEnglish
- lmms-lab/LLaVA-Video-178KVisual Question Answering, Video Text To TextEN
- lmms-lab/M4-Instruct-DataVisual Question Answering, Question AnsweringEN
- longvideobench/LongVideoBenchMultiple Choice, Visual Question AnsweringEN
- MAmmoTH-VL/MAmmoTH-VL-Instruct-12MVisual Question Answering, Question AnsweringEN
- maritaca-ai/enemVisual Question Answering, Multiple ChoicePT
- MathLLMs/MathVisionQuestion Answering, Multiple Choice, Visual Question Answering, Text Generation, Image To Text, Image Text To TextEN
- MathLLMs/VoiceAssistant-EvalQuestion Answering, Visual Question Answering, Audio To Audio, Any To Any, Multiple Choice, Text GenerationEnglish
- mawadalla/scientific-figures-captions-contextVisual Question Answering, Document Question AnsweringEN
- mawadalla/scientific-figures-captions-xlVisual Question AnsweringEN
- mlinhbng/viet-cultural-vqaVisual Question Answering, Image Classification, Object DetectionVI, EN
- MMInstruction/VLFeedbackVisual Question AnsweringEnglish
- MMMU/MMMUQuestion Answering, Visual Question Answering, Multiple ChoiceENBenchmark
- MMMU/MMMU_ProQuestion Answering, Visual Question Answering, Multiple ChoiceENBenchmark
- moonshotai/WorldVQAVisual Question AnsweringEN, ZH
- multimodal-reasoning-lab/Zebra-CoTAny To Any, Image Text To Text, Visual Question AnsweringEnglish
- mvp-lab/LLaVA-OneVision-2-DataVideo Text To Text, Visual Question Answering, Image Text To TextEN
- neulab/MultiUIQuestion Answering, Visual Question AnsweringEN
- neulab/PangeaInstructVisual Question Answering, Question AnsweringAM, AR, BG
- nvidia/Llama-Nemotron-VLM-Dataset-v1Visual Question Answering, Image Text To Text, Image To TextEnglish
- nvidia/Nemotron-Image-Training-v3Visual Question Answering, Image Text To TextEnglish
- nvidia/Nemotron-VLM-Dataset-v2Visual Question Answering, Image Text To Text, Video Text To TextEnglish
- nyu-visionx/Cambrian-10MVisual Question Answering, Question AnsweringEN
- nyu-visionx/Cambrian-AlignmentVisual Question Answering, Question AnsweringEN
- nyu-visionx/CV-BenchVisual Question AnsweringEN
- nyu-visionx/VSI-BenchVisual Question AnsweringEN
- omegalabsinc/omega-multimodalVideo Text To Text, Video Classification, Image Classification, Image To Text, Image To Video, Image Feature Extraction, Visual Question Answering, Audio Classification, Audio To Audio, Text To Audio, Text To Image, Text To Speech, Text To VideoEnglish
- openbmb/RLAIF-V-DatasetImage Text To Text, Visual Question Answering, Any To AnyEN
- openbmb/RLHF-V-DatasetText Generation, Visual Question AnsweringEN
- openbmb/UltraSafetyVisual Question AnsweringEN
- OpenDataArena/MMFineReason-1.8M-Qwen3-VL-235B-ThinkingVisual Question Answering, Question Answering, Text Generation, Image Text To TextEN
- OpenDataArena/MMFineReason-Full-2.3M-Qwen3-VL-235B-ThinkingVisual Question Answering, Question Answering, Text GenerationEN
- OpenDataArena/MMFineReason-SFT-123K-Qwen3-VL-235B-ThinkingVisual Question Answering, Question Answering, Text GenerationEN
- opendatalab/ChartVerse-SFT-1.8MVisual Question Answering, Image Text To TextEN
- OpenGVLab/MMPRVisual Question AnsweringEN
- OpenGVLab/MMPR-v1.1Visual Question AnsweringEN
- OpenGVLab/MVBenchVisual Question Answering, Video ClassificationEN
- OpenGVLab/OmniCorpus-CCImage To Text, Visual Question AnsweringEN
- OpenGVLab/OmniCorpus-CC-210MImage To Text, Visual Question AnsweringEN
- OpenGVLab/ShareGPT-4oVisual Question Answering, Question AnsweringEN
- OpenGVLab/VideoChat2-ITVisual Question Answering, Question AnsweringEN
- princeton-nlp/CharXivVisual Question Answering, Document Question Answering, Question AnsweringEN
- qixuewei/nuReasoningVisual Question Answering, Text Generation, RoboticsEnglish
- raidium/RadImageNet-VQAVisual Question AnsweringEN
- ranjaykrishna/visual_genomeImage To Text, Object Detection, Visual Question AnsweringEN
- rwlinno/GSA_volcVisual Question Answering, Object DetectionEN, ZH
- SakanaAI/ALE-BenchImage Text To Text, Reinforcement Learning, Text Generation, Visual Question AnsweringEN, JA
- ScienceOne-AI/S1-MMAlignImage To Text, Visual Question Answering, Feature ExtractionEN
- ShareGPT4Video/ShareGPT4VideoVisual Question Answering, Question AnsweringEN
- sii-rhos-ai/ViFailback-DatasetVisual Question Answering, RoboticsEN
- SimulaMet/Kvasir-VQA-x1Visual Question Answering, Image Text To TextEN
- SyedNazmusSakib/PlantInquiryVQAVisual Question Answering, Image ClassificationEN
- terryoo/TableVQA-BenchTable Question Answering, Visual Question AnsweringEN
- ThinkingHub/PPVideo Classification, Image Classification, Visual Question AnsweringEN
- TIGER-Lab/VisualWebInstructQuestion Answering, Visual Question Answering, Image Text To TextEN
- TMarcus/MindCraftVisual Question Answering, RoboticsENBenchmark
- tomg-group-umd/cinepileVisual Question Answering, Video Text To TextEN
- tomg-group-umd/pixelproseImage To Text, Text To Image, Visual Question AnsweringEN
- TransCity-VLM/TransCity-VLM-datasetQuestion Answering, Visual Question AnsweringEN
- turing-motors/Cauldron-JAVisual Question AnsweringJA
- Vi-VLM/VistaVisual Question AnsweringVI
- Video-Reason/VBVR-DatasetVideo Classification, Visual Question Answering, Video Text To TextEN
- vikhyatk/lnqaVisual Question AnsweringEnglish
- visheratin/realworldqaVisual Question AnsweringEN
- Visual Commonsense GraphsVisual Question Answering, CommonsenseEnglish
- Visual GenomeVisual Question Answering, Knowkedge BaseEnglish
- visual-layer/imagenet-1k-vl-enrichedObject Detection, Image Classification, Text To Image, Image To Text, Visual Question AnsweringEN
- Visual QA (VQA)Visual Question AnsweringEnglish
- VLR-CVC/DocVQA-2026Visual Question Answering, Document Question Answering, Image Text To Text, Question AnsweringEN
- worldbenchmark/IntuitivePhysicsVisual Question Answering, Text To VideoEN
- Xkev/LLaVA-CoT-100kVisual Question Answering, Image Text To TextEN
- yiyangd/pointarena_datasetImage Text To Text, Visual Question AnsweringEN
- YYQ898/Obshazard-benchVisual Question Answering, Image ClassificationEN
- zhongshsh/CLoT-Oogiri-GOVisual Question Answering, Question AnsweringEN, ZH, JA