SOTAVerified

Multimodal Machine Translation

Multimodal machine translation is the task of doing machine translation with multiple data sources - for example, translating "a bird is flying over water" + an image of a bird over water to German text.

( Image credit: Findings of the Third Shared Task on Multimodal Machine Translation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 71–80 of 108 papers

TitleStatusHype
Probing the Need for Visual Context in Multimodal Machine Translation—0
Rakuten’s Participation in WAT 2021: Examining the Effectiveness of Pre-trained Models for Multilingual and Multimodal Machine Translation—0
Sheffield MultiMT: Using Object Posterior Predictions for Multimodal Machine Translation—0
Sheffield Submissions for WMT18 Multimodal Translation Shared Task—0
SHEF-Multimodal: Grounding Machine Translation on Images—0
Supervised Visual Attention for Simultaneous Multimodal Machine Translation—0
The AFRL-Ohio State WMT18 Multimodal System: Combining Visual with Traditional—0
The AFRL-OSU WMT17 Multimodal Translation System: An Image Processing Approach—0
The Case for Evaluating Multimodal Translation Models on Text Datasets—0
The MeMAD Submission to the WMT18 Multimodal Translation Task—0
Show:102550
← PrevPage 8 of 11Next →
All datasetsMulti30KHindi Visual Genome (Challenge Set)Hindi Visual Genome (Test Set)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1delMeteor (EN-FR)74.6—Unverified
2ERNIE-UniX2BLEU (EN-DE)49.3—Unverified
3IKD-MMTBLEU (EN-DE)41.28—Unverified
4DCCNBLEU (EN-DE)39.7—Unverified
5CaglayanBLEU (EN-DE)39.4—Unverified
6Gumbel-Attention MMTBLEU (EN-DE)39.2—Unverified
7Multimodal TransformerBLEU (EN-DE)38.7—Unverified
8ImagiTBLEU (EN-DE)38.4—Unverified
9del+objBLEU (EN-DE)38—Unverified
10VMMTFBLEU (EN-DE)37.6—Unverified
#ModelMetricClaimedVerifiedStatus
1ViTABLEU (EN-HI)51.6—Unverified
#ModelMetricClaimedVerifiedStatus
1ViTABLEU (EN-HI)44.6—Unverified