Seamless: Multilingual Expressive and Streaming Speech Translation Dec 8, 2023 automatic-speech-translation Machine Translation
Code Code Available 5 Attention Is All You Need Jun 12, 2017 Abstractive Text Summarization All
Code Code Available 5 M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training Jun 4, 2020 Image Captioning Image Retrieval
Code Code Available 5 Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation Dec 20, 2022 Machine Translation Multimodal Machine Translation
Code Code Available 5 Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation Oct 10, 2022 Knowledge Distillation Machine Translation
Code Code Available 5 BERTGEN: Multi-task Generation through BERT Jun 7, 2021 Decoder Image Captioning
Code Code Available 5 Neural Machine Translation with Phrase-Level Universal Visual Representations Mar 19, 2022 Machine Translation Multimodal Machine Translation
Code Code Available 5 CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Aug 29, 2023 Image Captioning Machine Translation
Code Code Available 5 Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination May 20, 2023 Hallucination Machine Translation
Code Code Available 5 Self-Knowledge Distillation with Progressive Refinement of Targets Jun 22, 2020 image-classification Image Classification
Code Code Available 5 VISA: An Ambiguous Subtitles Dataset for Visual Scene-Aware Machine Translation Jan 20, 2022 Machine Translation Multimodal Machine Translation
Code Code Available 5 BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation May 23, 2023 Contrastive Learning Machine Translation
Code Code Available 5 Multimodal Transformer for Multimodal Machine Translation Jul 1, 2020 Machine Translation Multimodal Machine Translation
Code Code Available 5 On Vision Features in Multimodal Machine Translation Mar 17, 2022 Image Captioning Machine Translation
Code Code Available 5 VALHALLA: Visual Hallucination for Machine Translation May 31, 2022 Hallucination Machine Translation
Code Code Available 5 Cross-lingual Visual Pre-training for Multimodal Machine Translation Jan 25, 2021 Language Modelling Machine Translation
Code Code Available 5 3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset Apr 29, 2024 Machine Translation Multimodal Machine Translation
Code Code Available 5 MSCTD: A Multimodal Sentiment Chat Translation Dataset Feb 28, 2022 Machine Translation Multimodal Machine Translation
Code Code Available 5 Dynamic Context-guided Capsule Network for Multimodal Machine Translation Sep 4, 2020 Decoder Machine Translation
Code Code Available 5 Multimodal Lexical Translation May 1, 2018 Machine Translation Multimodal Lexical Translation
Code Code Available 5 Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation Oct 20, 2023 Decoder Image Generation
Code Code Available 5 Multimodal Machine Translation with Embedding Prediction Apr 1, 2019 Machine Translation Multimodal Machine Translation
Code Code Available 5 Distilling Translations with Visual Awareness Jun 18, 2019 Decoder Machine Translation
Code Code Available 5 Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation Dec 20, 2022 Machine Translation Multimodal Machine Translation
Code Code Available 5 Multi30K: Multilingual English-German Image Descriptions May 2, 2016 Image Description Machine Translation
Code Code Available 5 