SOTAVerified

Speech Recognition

Speech Recognition is the task of converting spoken language into text. It involves recognizing the words spoken in an audio recording and transcribing them into a written format. The goal is to accurately transcribe the speech in real-time or from recorded audio, taking into account factors such as accents, speaking speed, and background noise.

( Image credit: SpecAugment )

Papers

Showing 1–25 of 6433 papers

TitleStatusHype
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingCode11
CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic TokensCode11
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMsCode11
Moonshine: Speech Recognition for Live Transcription and Voice CommandsCode9
Moshi: a speech-text foundation model for real-time dialogueCode9
Adapting Large Language Model with Speech for Fully Formatted End-to-End Speech RecognitionCode8
Robust Speech Recognition via Large-Scale Weak SupervisionCode8
Speechless: Speech Instruction Training Without Speech for Low Resource LanguagesCode7
Kimi-Audio Technical ReportCode7
Qwen2.5-Omni Technical ReportCode7
GLM-4-Voice: Towards Intelligent and Human-Like End-to-End Spoken ChatbotCode7
Scaling Speech-Text Pre-training with Synthetic Interleaved DataCode7
Ichigo: Mixed-Modal Early-Fusion Realtime Voice AssistantCode7
OxfordVGG Submission to the EGO4D AV Transcription ChallengeCode6
PaddleSpeech: An Easy-to-Use All-in-One Speech ToolkitCode6
FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM IntegrationCode5
StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task LearningCode5
WeNet 2.0: More Productive End-to-End Speech Recognition ToolkitCode5
GigaAM: Efficient Self-Supervised Learner for Speech RecognitionCode4
Multi-head Temporal Latent AttentionCode4
VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language ModelCode4
Dolphin: A Large-Scale Automatic Speech Recognition Model for Eastern LanguagesCode4
CrisperWhisper: Accurate Timestamps on Verbatim Speech TranscriptionsCode4
The Llama 3 Herd of ModelsCode4
A Survey on Vision-Language-Action Models for Embodied AICode4
Show:102550
← PrevPage 1 of 258Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AmNetWord Error Rate (WER)8.6—Unverified
2HMM-(SAT)GMMWord Error Rate (WER)8—Unverified
3Local Prior Matching (Large Model)Word Error Rate (WER)7.19—Unverified
4SnipsWord Error Rate (WER)6.4—Unverified
5Li-GRUWord Error Rate (WER)6.2—Unverified
6HMM-DNN + pNorm*Word Error Rate (WER)5.5—Unverified
7CTC + policy learningWord Error Rate (WER)5.42—Unverified
8Deep Speech 2Word Error Rate (WER)5.33—Unverified
9HMM-TDNN + iVectorsWord Error Rate (WER)4.8—Unverified
10Gated ConvNetsWord Error Rate (WER)4.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Local Prior Matching (Large Model)Word Error Rate (WER)20.84—Unverified
2SnipsWord Error Rate (WER)16.5—Unverified
3Local Prior Matching (Large Model, ConvLM LM)Word Error Rate (WER)15.28—Unverified
4Deep Speech 2Word Error Rate (WER)13.25—Unverified
5TDNN + pNorm + speed up/down speechWord Error Rate (WER)12.5—Unverified
6CTC-CRF 4gram-LMWord Error Rate (WER)10.65—Unverified
7Convolutional Speech RecognitionWord Error Rate (WER)10.47—Unverified
8MT4SSLWord Error Rate (WER)9.6—Unverified
9Jasper DR 10x5Word Error Rate (WER)8.79—Unverified
10EspressoWord Error Rate (WER)8.7—Unverified
#ModelMetricClaimedVerifiedStatus
1Deep SpeechPercentage error20—Unverified
2DNN-HMMPercentage error18.5—Unverified
3CD-DNNPercentage error16.1—Unverified
4DNNPercentage error16—Unverified
5DNN + DropoutPercentage error15—Unverified
6DNN MMIPercentage error12.9—Unverified
7HMM-TDNN + pNorm + speed up/down speechPercentage error12.9—Unverified
8DNN BMMIPercentage error12.9—Unverified
9DNN MPEPercentage error12.9—Unverified
10Deep Speech + FSHPercentage error12.6—Unverified
#ModelMetricClaimedVerifiedStatus
1LSNNPercentage error33.2—Unverified
2LAS multitask with indicators samplingPercentage error20.4—Unverified
3Soft Monotonic Attention (ours, offline)Percentage error20.1—Unverified
4QCNN-10L-256FMPercentage error19.64—Unverified
5Bi-LSTM + skip connections w/ CTCPercentage error17.7—Unverified
6Bi-RNN + AttentionPercentage error17.6—Unverified
7RNN-CRF on 24(x3) MFSCPercentage error17.3—Unverified
8CNN in time and frequency + dropout, 17.6% w/o dropoutPercentage error16.7—Unverified
9Light Gated Recurrent UnitsPercentage error16.7—Unverified
10GRUPercentage error16.6—Unverified
#ModelMetricClaimedVerifiedStatus
1AttWord Error Rate (WER)18.7—Unverified
2CTC/AttWord Error Rate (WER)6.7—Unverified
3BRA-EWord Error Rate (WER)6.63—Unverified
4CTC-CRF 4gram-LMWord Error Rate (WER)6.34—Unverified
5BATWord Error Rate (WER)4.97—Unverified
6ParaformerWord Error Rate (WER)4.95—Unverified
7U2Word Error Rate (WER)4.72—Unverified
8UMAWord Error Rate (WER)4.7—Unverified
9Lightweight TransducerWord Error Rate (WER)4.31—Unverified
10CIF-HKD With LMWord Error Rate (WER)4.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Jasper 10x3Word Error Rate (WER)6.9—Unverified
2CNN over RAW speech (wav)Word Error Rate (WER)5.6—Unverified
3CTC-CRF 4gram-LMWord Error Rate (WER)3.79—Unverified
4test-set on open vocabulary (i.e. harder), model = HMM-DNN + pNorm*Word Error Rate (WER)3.6—Unverified
5Deep Speech 2Word Error Rate (WER)3.6—Unverified
6Convolutional Speech RecognitionWord Error Rate (WER)3.5—Unverified
7TC-DNN-BLSTM-DNNWord Error Rate (WER)3.5—Unverified
8EspressoWord Error Rate (WER)3.4—Unverified
9CTC-CRF VGG-BLSTMWord Error Rate (WER)3.2—Unverified
10Transformer with Relaxed AttentionWord Error Rate (WER)3.19—Unverified