SOTAVerified

Speech-to-Text Translation

Translate audio signals of speech in one language into text in a foreign language, either in an end-to-end or cascade manner.

Papers

Showing 101146 of 146 papers

TitleStatusHype
Subtitles to Segmentation: Improving Low-Resource Speech-to-TextTranslation Pipelines0
Subtitles to Segmentation: Improving Low-Resource Speech-to-Text Translation Pipelines0
TASK AWARE MULTI-TASK LEARNING FOR SPEECH TO TEXT TASKS0
The USFD Spoken Language Translation System for IWSLT 20140
Towards Measuring Fairness in AI: the Casual Conversations Dataset0
Towards speech-to-text translation without speech recognition0
Towards the evaluation of automatic simultaneous speech translation from a communicative perspective0
Towards Unsupervised Speech-to-Text Translation0
Unsupervised Cross-Modal Alignment of Speech and Text Embedding Spaces0
Unveiling the Role of Pretraining in Direct Speech Translation0
Using of heterogeneous corpora for training of an ASR system0
When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation0
MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation0
Modular Speech-to-Text Translation for Zero-Shot Cross-Modal Transfer0
NAIST Simultaneous Speech-to-Text Translation System for IWSLT 20220
NAIST Simultaneous Speech Translation System for IWSLT 20240
Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision0
On decoder-only architecture for speech-to-text and large language model integration0
M-Adapter: Modality Adaptation for End-to-End Speech-to-Text TranslationCode0
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text TranslationCode0
Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text TranslationCode0
SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech TranslationCode0
Listen and Speak Fairly: A Study on Semantic Gender Bias in Speech Integrated Large Language ModelsCode0
Voices Unheard: NLP Resources and Models for Yorùbá Regional DialectsCode0
SparQLe: Speech Queries to Text Translation Through LLMsCode0
NeurST: Neural Speech Translation ToolkitCode0
Synchronous Speech Recognition and Speech-to-Text Translation with Interactive DecodingCode0
Speechformer: Reducing Information Loss in Direct Speech TranslationCode0
LibriS2S: A German-English Speech-to-Speech Translation CorpusCode0
Contextualized Translation of Automatically Segmented SpeechCode0
Investigating Zero-Shot Generalizability on Mandarin-English Code-Switched ASR and Speech-to-text Translation of Recent Foundation Models with Self-Supervision and Weak SupervisionCode0
Pre-training on high-resource speech recognition improves low-resource speech-to-text translationCode0
CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation UnitsCode0
Infusing Future Information into Monotonic Attention Through Language ModelsCode0
WACO: Word-Aligned Contrastive Learning for Speech TranslationCode0
Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language UnderstandingCode0
Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation EvaluationCode0
Revisiting End-to-End Speech-to-Text Translation From ScratchCode0
Don't Discard Fixed-Window Audio Segmentation in Speech-to-Text TranslationCode0
BeaverTalk: Oregon State University's IWSLT 2025 Simultaneous Speech Translation SystemCode0
StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History SelectionCode0
fairseq S2T: Fast Speech-to-Text Modeling with fairseqCode0
ESPnet-ST-v2: Multipurpose Spoken Language Translation ToolkitCode0
Direct speech-to-speech translation with a sequence-to-sequence modelCode0
End-to-End Automatic Speech Translation of AudiobooksCode0
Efficient Speech Translation with Dynamic Latent PerceiversCode0
Show:102550
← PrevPage 3 of 3Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Task Modulation + Multitask Learning(ASR/MT) + Data AugmentationCase-sensitive sacreBLEU28.88Unverified
2Wav2Vec2.0+mBART+AdaptorsCase-sensitive sacreBLEU28.22Unverified
3Transformer + Meta Learning(ASR/MT) + Data AugmentationCase-sensitive sacreBLEU27.51Unverified
4Transformer with AdaptersCase-sensitive sacreBLEU24.63Unverified
5Dual-decoder TransformerCase-sensitive sacreBLEU23.63Unverified
6SpeechformerCase-sensitive sacreBLEU23.6Unverified
7Transformer + ASR PretrainCase-sensitive sacreBLEU22.8Unverified
8Transformer + ASR PretrainCase-sensitive sacreBLEU22.7Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer with AdaptersCase-sensitive sacreBLEU28.73Unverified
2SpeechformerCase-sensitive sacreBLEU28.5Unverified
3Dual-decoder TransformerCase-sensitive sacreBLEU28.12Unverified
4Transformer + ASR Pretrain + SpecAugCase-sensitive sacreBLEU27.4Unverified
5Transformer + ASR PretrainCase-sensitive sacreBLEU26.8Unverified
#ModelMetricClaimedVerifiedStatus
1Dual-decoder TransformerCase-sensitive sacreBLEU33.45Unverified
2Transformer + ASR Pretrain + SpecAugCase-sensitive sacreBLEU33.3Unverified
3Transformer + ASR PretrainCase-sensitive sacreBLEU32.3Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU30.6Unverified
2SeamlessM4T MediumBLEU26.6Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU34.1Unverified
2SeamlessM4T MediumBLEU29.8Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU21.5Unverified
2SeamlessM4T MediumBLEU19.2Unverified
#ModelMetricClaimedVerifiedStatus
1SeamlessM4T LargeBLEU24Unverified
2SeamlessM4T MediumBLEU20.9Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + ASR Pretrain + SpecAugCase-insensitive sacreBLEU17.2Unverified
2Transformer + ASR PretrainCase-insensitive sacreBLEU16.5Unverified
#ModelMetricClaimedVerifiedStatus
1MediBeng Whisper TinyBleu0.98Unverified
2Whisper TinyBleu0.3Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer with AdaptersSacreBLEU26.61Unverified
2Dual-decoder TransformerSacreBLEU25.62Unverified
#ModelMetricClaimedVerifiedStatus
1SpeechformerCase-sensitive sacreBLEU27.7Unverified