Speech-to-Text Translation
Translate audio signals of speech in one language into text in a foreign language, either in an end-to-end or cascade manner.
Papers
No papers found.
All datasetsMuST-C EN->DEMuST-C EN->ESMuST-C EN->FRCoVoST 2 eng-XCoVoST 2 X-engFLEURS eng-XFLEURS X-englibri-transMediBengMuST-CMuST-C EN->NL
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Task Modulation + Multitask Learning(ASR/MT) + Data Augmentation | Case-sensitive sacreBLEU | 28.88 | — | Unverified |
| 2 | Wav2Vec2.0+mBART+Adaptors | Case-sensitive sacreBLEU | 28.22 | — | Unverified |
| 3 | Transformer + Meta Learning(ASR/MT) + Data Augmentation | Case-sensitive sacreBLEU | 27.51 | — | Unverified |
| 4 | Transformer with Adapters | Case-sensitive sacreBLEU | 24.63 | — | Unverified |
| 5 | Dual-decoder Transformer | Case-sensitive sacreBLEU | 23.63 | — | Unverified |
| 6 | Speechformer | Case-sensitive sacreBLEU | 23.6 | — | Unverified |
| 7 | Transformer + ASR Pretrain | Case-sensitive sacreBLEU | 22.8 | — | Unverified |
| 8 | Transformer + ASR Pretrain | Case-sensitive sacreBLEU | 22.7 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Transformer with Adapters | Case-sensitive sacreBLEU | 28.73 | — | Unverified |
| 2 | Speechformer | Case-sensitive sacreBLEU | 28.5 | — | Unverified |
| 3 | Dual-decoder Transformer | Case-sensitive sacreBLEU | 28.12 | — | Unverified |
| 4 | Transformer + ASR Pretrain + SpecAug | Case-sensitive sacreBLEU | 27.4 | — | Unverified |
| 5 | Transformer + ASR Pretrain | Case-sensitive sacreBLEU | 26.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Dual-decoder Transformer | Case-sensitive sacreBLEU | 33.45 | — | Unverified |
| 2 | Transformer + ASR Pretrain + SpecAug | Case-sensitive sacreBLEU | 33.3 | — | Unverified |
| 3 | Transformer + ASR Pretrain | Case-sensitive sacreBLEU | 32.3 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SeamlessM4T Large | BLEU | 30.6 | — | Unverified |
| 2 | SeamlessM4T Medium | BLEU | 26.6 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SeamlessM4T Large | BLEU | 34.1 | — | Unverified |
| 2 | SeamlessM4T Medium | BLEU | 29.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SeamlessM4T Large | BLEU | 21.5 | — | Unverified |
| 2 | SeamlessM4T Medium | BLEU | 19.2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SeamlessM4T Large | BLEU | 24 | — | Unverified |
| 2 | SeamlessM4T Medium | BLEU | 20.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Transformer + ASR Pretrain + SpecAug | Case-insensitive sacreBLEU | 17.2 | — | Unverified |
| 2 | Transformer + ASR Pretrain | Case-insensitive sacreBLEU | 16.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MediBeng Whisper Tiny | Bleu | 0.98 | — | Unverified |
| 2 | Whisper Tiny | Bleu | 0.3 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Transformer with Adapters | SacreBLEU | 26.61 | — | Unverified |
| 2 | Dual-decoder Transformer | SacreBLEU | 25.62 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Speechformer | Case-sensitive sacreBLEU | 27.7 | — | Unverified |