SOTAVerified

Multimodal Machine Translation

Multimodal machine translation is the task of doing machine translation with multiple data sources - for example, translating "a bird is flying over water" + an image of a bird over water to German text.

( Image credit: Findings of the Third Shared Task on Multimodal Machine Translation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 71–80 of 108 papers

TitleStatusHype
Multimodal Machine Translation with Embedding PredictionCode0
Probing the Need for Visual Context in Multimodal Machine Translation—0
Latent Variable Model for Multi-modal TranslationCode0
UMONS Submission for WMT18 Multimodal Translation TaskCode0
Input Combination Strategies for Multi-Source Transformer Decoder—0
CUNI System for the WMT18 Multimodal Translation Task—0
Findings of the 2018 Conference on Machine Translation (WMT18)—0
Findings of the Third Shared Task on Multimodal Machine TranslationCode0
Sheffield Submissions for WMT18 Multimodal Translation Shared Task—0
The AFRL-Ohio State WMT18 Multimodal System: Combining Visual with Traditional—0
Show:102550
← PrevPage 8 of 11Next →
All datasetsMulti30KHindi Visual Genome (Challenge Set)Hindi Visual Genome (Test Set)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1delMeteor (EN-FR)74.6—Unverified
2ERNIE-UniX2BLEU (EN-DE)49.3—Unverified
3IKD-MMTBLEU (EN-DE)41.28—Unverified
4DCCNBLEU (EN-DE)39.7—Unverified
5CaglayanBLEU (EN-DE)39.4—Unverified
6Gumbel-Attention MMTBLEU (EN-DE)39.2—Unverified
7Multimodal TransformerBLEU (EN-DE)38.7—Unverified
8ImagiTBLEU (EN-DE)38.4—Unverified
9del+objBLEU (EN-DE)38—Unverified
10VMMTFBLEU (EN-DE)37.6—Unverified
#ModelMetricClaimedVerifiedStatus
1ViTABLEU (EN-HI)51.6—Unverified
#ModelMetricClaimedVerifiedStatus
1ViTABLEU (EN-HI)44.6—Unverified