SOTAVerified

Speech-to-Text Translation

Translate audio signals of speech in one language into text in a foreign language, either in an end-to-end or cascade manner.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–146 of 146 papers

TitleStatusHype
CoLLD: Contrastive Layer-to-layer Distillation for Compressing Multilingual Pre-trained Speech Encoders—0
Compact Speech Translation Models via Discrete Speech Units Pretraining—0
Contextual Biasing to Improve Domain-specific Custom Vocabulary Audio Transcription without Explicit Fine-Tuning of Whisper Model—0
Contextualized Translation of Automatically Segmented Speech—0
COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning—0
Cross-modal Contrastive Learning for Speech Translation—0
Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing—0
CTC Alignments Improve Autoregressive Translation—0
Data Efficient Direct Speech-to-Text Translation with Modality Agnostic Meta-Learning—0
Decision Attentive Regularization to Improve Simultaneous Speech Translation Systems—0
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR—0
Efficient Monotonic Multihead Attention—0
End-to-End Offline Speech Translation System for IWSLT 2020 using Modality Agnostic Meta-Learning—0
End-to-End Speech-to-Text Translation: A Survey—0
End-to-End Speech Translation for Low-Resource Languages Using Weakly Labeled Data—0
Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentation—0
Enhancing Speech-to-Speech Translation with Multiple TTS Targets—0
Enhancing Transformer for End-to-end Speech-to-Text Translation—0
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit—0
Europarl-ST: A Multilingual Corpus For Speech Translation Of Parliamentary Debates—0
Finetuning End-to-End Models for Estonian Conversational Spoken Language Translation—0
Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages—0
How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?—0
Hybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks—0
Improved Cross-Lingual Transfer Learning For Automatic Speech Translation—0
Improve Sinhala Speech Recognition Through e2e LF-MMI Model—0
Improving Cross-Lingual Transfer Learning for End-to-End Speech Recognition with Speech Translation—0
Improving Language and Modality Transfer in Translation by Character-level Modeling—0
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task—0
Improving Stability in Simultaneous Speech Translation: A Revision-Controllable Decoding Approach—0
Infusing Future Information into Monotonic Attention Through Language Models—0
Instance-Based Model Adaptation For Direct Speech Translation—0
Interpreting Strategies Annotation in the WAW Corpus—0
Investigating Decoder-only Large Language Models for Speech-to-text Translation—0
Isochrony-Controlled Speech-to-Text Translation: A study on translating from Sino-Tibetan to Indo-European Languages—0
Language Model Augmented Monotonic Attention for Simultaneous Translation—0
Learning Adaptive Segmentation Policy for End-to-End Simultaneous Translation—0
Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translation—0
Low-Resource Speech-to-Text Translation—0
M3ST: Mix at Three Levels for Speech Translation—0
MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation—0
Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer—0
NAIST Simultaneous Speech-to-Text Translation System for IWSLT 2022—0
NAIST Simultaneous Speech Translation System for IWSLT 2024—0
NeurST: Neural Speech Translation Toolkit—0
Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision—0
Show:102550
← PrevPage 3 of 3Next →
All datasetsMuST-C EN->DEMuST-C EN->ESMuST-C EN->FRCoVoST 2 eng-XCoVoST 2 X-engFLEURS eng-XFLEURS X-englibri-transMediBengMuST-CMuST-C EN->NL

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Task Modulation + Multitask Learning(ASR/MT) + Data AugmentationCase-sensitive sacreBLEU28.88—Unverified
2Wav2Vec2.0+mBART+AdaptorsCase-sensitive sacreBLEU28.22—Unverified
3Transformer + Meta Learning(ASR/MT) + Data AugmentationCase-sensitive sacreBLEU27.51—Unverified
4Transformer with AdaptersCase-sensitive sacreBLEU24.63—Unverified
5Dual-decoder TransformerCase-sensitive sacreBLEU23.63—Unverified
6SpeechformerCase-sensitive sacreBLEU23.6—Unverified
7Transformer + ASR PretrainCase-sensitive sacreBLEU22.8—Unverified
8Transformer + ASR PretrainCase-sensitive sacreBLEU22.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer with AdaptersCase-sensitive sacreBLEU28.73—Unverified
2SpeechformerCase-sensitive sacreBLEU28.5—Unverified
3Dual-decoder TransformerCase-sensitive sacreBLEU28.12—Unverified
4Transformer + ASR Pretrain + SpecAugCase-sensitive sacreBLEU27.4—Unverified
5Transformer + ASR PretrainCase-sensitive sacreBLEU26.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Dual-decoder TransformerCase-sensitive sacreBLEU33.45—Unverified
2Transformer + ASR Pretrain + SpecAugCase-sensitive sacreBLEU33.3—Unverified
3Transformer + ASR PretrainCase-sensitive sacreBLEU32.3—Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU30.6—Unverified
2SeamlessM4T MediumBLEU26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU34.1—Unverified
2SeamlessM4T MediumBLEU29.8—Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU21.5—Unverified
2SeamlessM4T MediumBLEU19.2—Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU24—Unverified
2SeamlessM4T MediumBLEU20.9—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + ASR Pretrain + SpecAugCase-insensitive sacreBLEU17.2—Unverified
2Transformer + ASR PretrainCase-insensitive sacreBLEU16.5—Unverified
#ModelMetricClaimedVerifiedStatus
1MediBeng Whisper TinyBleu0.98—Unverified
2Whisper TinyBleu0.3—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer with AdaptersSacreBLEU26.61—Unverified
2Dual-decoder TransformerSacreBLEU25.62—Unverified
#ModelMetricClaimedVerifiedStatus
1SpeechformerCase-sensitive sacreBLEU27.7—Unverified