Multi-Modal Learning Datasets
There are 13 multi-modal learning datasets in our directory, 1 of which are benchmarks. Each links to its source, paper, and download — browse the full list below or filter by language.
Multi-Modal Learning is a machine-learning task covered in our directory. We catalog 13 datasets for it.
- Action Learning From Realistic Environments and Directives (ALFRED)Multi-Modal LearningEnglish
- Audio Visual Scene-Aware Dialog (AVSD)Multi-Modal Learning, Video Question Answering, DialogueEnglish
- MovieQAMulti-Modal Learning, Video Question AnsweringEnglish
- Multi30kMachine Translation, Multi-Modal LearningGerman, English
- Multimodal EmotionLines Dataset (MELD)Multi-Modal LearningEnglish
- Multimodal Sarcasm Detection Dataset (MUStARD)Multi-Modal LearningEnglishBenchmark
- Street View Text (SVT)Multi-Modal Learning, Scene Text RecognitionEnglish
- TGIF-QAMulti-Modal Learning, Video Question AnsweringEnglish
- TVQAMulti-Modal Learning, Video Question AnsweringEnglish
- Twitter100kMulti-Modal LearningEnglish
- VIdeO-and-Language INference (VIOLIN)Multi-Modal LearningEnglish
- Visual Storytelling Dataset (VIST)Multi-Modal LearningEnglish
- WAT 2019 Hindi-EnglishMachine Translation, Multi-Modal LearningHindi, English