SOTAVerified

Machine Translation

Machine translation is the task of translating a sentence in a source language to a different target language.

Approaches for machine translation can range from rule-based to statistical to neural-based. More recently, encoder-decoder attention-based architectures like BERT have attained major improvements in machine translation.

One of the most popular datasets used to benchmark machine translation systems is the WMT family of datasets. Some of the most commonly used evaluation metrics for machine translation systems include BLEU, METEOR, NIST, and others.

( Image credit: Google seq2seq )

Papers

Showing 150 of 10752 papers

TitleStatusHype
(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary TextsCode9
Seamless: Multilingual Expressive and Streaming Speech TranslationCode6
M-Prometheus: A Suite of Open Multilingual LLM JudgesCode5
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task LearningCode5
ChatGPT MT: Competitive for High- (but not Low-) Resource LanguagesCode5
How to Design Translation Prompts for ChatGPT: An Empirical StudyCode5
Knowledge Fusion of Large Language ModelsCode4
Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine TranslationCode4
Efficient Post-training Quantization with FP8 FormatsCode4
ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement LearningCode3
DRT-o1: Optimized Deep Reasoning Translation via Long Chain-of-ThoughtCode3
Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation DatasetCode3
Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence SegmentationCode3
Accelerating Transformer Inference for Translation via Parallel DecodingCode3
TextBox 2.0: A Text Generation Library with Pre-trained Language ModelsCode3
Bird-Eye Transformers for Text Generation ModelsCode3
8-bit Optimizers via Block-wise QuantizationCode3
Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden IntermediatesCode3
Finetuned Language Models Are Zero-Shot LearnersCode3
Towards Fully Automated Manga TranslationCode3
Ludwig: a type-based declarative deep learning toolboxCode3
Attention Is All You NeedCode3
MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement LearningCode2
MultiMed-ST: Large-scale Many-to-many Multilingual Medical Speech TranslationCode2
WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & DialectsCode2
DelTA: An Online Document-Level Translation Agent Based on Multi-Level MemoryCode2
Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLPCode2
CATT: Character-based Arabic Tashkeel TransformerCode2
Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next LevelCode2
Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion AlgorithmsCode2
TransVIP: Speech to Speech Translation System with Voice and Isochrony PreservationCode2
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic LanguagesCode2
Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and ChallengesCode2
MIND Your Language: A Multilingual Dataset for Cross-lingual News RecommendationCode2
Enhancing Taiwanese Hokkien Dual Translation by Exploring and Standardizing of Four Writing SystemsCode2
TEaR: Improving LLM-based Machine Translation with Systematic Self-RefinementCode2
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine TranslatorsCode2
LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTCode2
Quantifying the Plausibility of Context Reliance in Neural Machine TranslationCode2
A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language ModelsCode2
OWL: A Large Language Model for IT OperationsCode2
SONAR: Sentence-Level Multimodal and Language-Agnostic RepresentationsCode2
SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationCode2
Encouraging Divergent Thinking in Large Language Models through Multi-Agent DebateCode2
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 LanguagesCode2
IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian LanguagesCode2
HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine TranslationCode2
Exploring Human-Like Translation Strategy with Large Language ModelsCode2
Self-Supervised Multimodal Learning: A SurveyCode2
Stabilizing Transformer Training by Preventing Attention Entropy CollapseCode2
Show:102550
← PrevPage 1 of 216Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Transformer Cycle (Rev)BLEU score35.14Unverified
2Noisy back-translationBLEU score35Unverified
3Transformer+Rep(Uni)BLEU score33.89Unverified
4T5-11BBLEU score32.1Unverified
5BiBERTBLEU score31.26Unverified
6Transformer + R-DropBLEU score30.91Unverified
7Bi-SimCutBLEU score30.78Unverified
8BERT-fused NMTBLEU score30.75Unverified
9Data Diversification - TransformerBLEU score30.7Unverified
10SimCutBLEU score30.56Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer+BT (ADMIN init)BLEU score46.4Unverified
2Noisy back-translationBLEU score45.6Unverified
3mRASP+Fine-TuneBLEU score44.3Unverified
4Transformer + R-DropBLEU score43.95Unverified
5Transformer (ADMIN init)BLEU score43.8Unverified
6AdminBLEU score43.8Unverified
7BERT-fused NMTBLEU score43.78Unverified
8MUSE(Paralllel Multi-scale Attention)BLEU score43.5Unverified
9T5BLEU score43.4Unverified
10Local Joint Self-attentionBLEU score43.3Unverified
#ModelMetricClaimedVerifiedStatus
1PiNMTBLEU score40.43Unverified
2BiBERTBLEU score38.61Unverified
3Bi-SimCutBLEU score38.37Unverified
4Cutoff + Relaxed Attention + LMBLEU score37.96Unverified
5DRDABLEU score37.95Unverified
6Transformer + R-Drop + CutoffBLEU score37.9Unverified
7SimCutBLEU score37.81Unverified
8Cutoff+KneeBLEU score37.78Unverified
9CutoffBLEU score37.6Unverified
10CipherDAugBLEU score37.53Unverified
#ModelMetricClaimedVerifiedStatus
1HWTSC-Teacher-SimScore19.97Unverified
2MS-COMET-22Score19.89Unverified
3MS-COMET-QE-22Score19.76Unverified
4KG-BERTScoreScore17.28Unverified
5metricx_xl_DA_2019Score17.17Unverified
6COMET-QEScore16.8Unverified
7COMET-22Score16.31Unverified
8UniTE-srcScore15.68Unverified
9UniTE-refScore15.38Unverified
10metricx_xxl_DA_2019Score15.24Unverified