SOTAVerified

Audio-Visual Speech Recognition

Audio-visual speech recognition is the task of transcribing a paired audio and visual stream into text.

Papers

Showing 76100 of 100 papers

TitleStatusHype
End-to-end Audio-visual Speech Recognition with ConformersCode1
Part-based Lipreading for Audio-Visual Speech Recognition0
AV Taris: Online Audio-Visual Speech RecognitionCode1
Lip Graph Assisted Audio-Visual Speech Recognition Using Bidirectional Synchronous Fusion0
Should we hard-code the recurrence concept or learn it instead ? Exploring the Transformer architecture for Audio-Visual Speech RecognitionCode1
Discriminative Multi-modality Speech RecognitionCode1
How to Teach DNNs to Pay Attention to the Visual Modality in Speech RecognitionCode1
Audio-visual Recognition of Overlapped speech for the LRS2 dataset0
Detecting Adversarial Attacks On Audiovisual Speech Recognition0
Recurrent Neural Network Transducer for Audio-Visual Speech RecognitionCode0
Investigating the Lombard Effect Influence on End-to-End Audio-Visual Speech Recognition0
Modality Attention for End-to-End Audio-visual Speech Recognition0
Audio-Visual Speech Recognition With A Hybrid CTC/Attention Architecture0
Deep Audio-Visual Speech RecognitionCode1
LRS3-TED: a large-scale dataset for visual speech recognitionCode0
Towards Lipreading Sentences with Active Appearance Models0
Multimodal Machine Learning: Integrating Language, Vision and Speech0
Deep Multimodal Representation Learning from Temporal Data0
Auxiliary Multimodal LSTM for Audio-visual Speech Recognition and Lipreading0
Audio Visual Speech Recognition using Deep Recurrent Neural Networks0
Deep Multimodal Learning for Audio-Visual Speech Recognition0
Visual Speech Recognition0
Recognition of Isolated Words using Zernike and MFCC features for Audio Visual Speech Recognition0
Building a synchronous corpus of acoustic and 3D facial marker data for adaptive audio-visual speech synthesis0
SUTAV: A Turkish Audio-Visual Database0
Show:102550
← PrevPage 4 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Hybrid CTC / AttentionWord Error Rate (WER)39.1Unverified
2TM-Seq2seqTest WER8.5Unverified
3TM-CTCTest WER8.2Unverified
4CTC/AttentionTest WER7Unverified
5CTC/AttentionTest WER1.5Unverified
6Whisper-FlamingoTest WER1.4Unverified
#ModelMetricClaimedVerifiedStatus
1Hyb-ConformerWord Error Rate (WER)2.3Unverified
2Zero-AVSRWord Error Rate (WER)1.5Unverified
3AV-HuBERT LargeWord Error Rate (WER)1.4Unverified
4Whisper-FlamingoWord Error Rate (WER)0.76Unverified
5MMS-LLaMAWord Error Rate (WER)0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AVCRFormerTop-1 Accuracy98.81Unverified
22DCNN + BiLSTM + ResNet + MLFTop-1 Accuracy98.76Unverified
3PBLTop-1 Accuracy98.3Unverified
#ModelMetricClaimedVerifiedStatus
1ES³ Base*Word Error Rate (WER)11Unverified