Multimodal Machine Translation
Multimodal machine translation is the task of doing machine translation with multiple data sources - for example, translating "a bird is flying over water" + an image of a bird over water to German text.
( Image credit: Findings of the Third Shared Task on Multimodal Machine Translation )
Papers
No papers found.
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | del | Meteor (EN-FR) | 74.6 | — | Unverified |
| 2 | ERNIE-UniX2 | BLEU (EN-DE) | 49.3 | — | Unverified |
| 3 | IKD-MMT | BLEU (EN-DE) | 41.28 | — | Unverified |
| 4 | DCCN | BLEU (EN-DE) | 39.7 | — | Unverified |
| 5 | Caglayan | BLEU (EN-DE) | 39.4 | — | Unverified |
| 6 | Gumbel-Attention MMT | BLEU (EN-DE) | 39.2 | — | Unverified |
| 7 | Multimodal Transformer | BLEU (EN-DE) | 38.7 | — | Unverified |
| 8 | ImagiT | BLEU (EN-DE) | 38.4 | — | Unverified |
| 9 | del+obj | BLEU (EN-DE) | 38 | — | Unverified |
| 10 | VMMTF | BLEU (EN-DE) | 37.6 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ViTA | BLEU (EN-HI) | 51.6 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ViTA | BLEU (EN-HI) | 44.6 | — | Unverified |