SOTAVerified

Visual Speech Recognition

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 182 papers

TitleStatusHype
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis—0
ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognition—0
Cocktail-Party Audio-Visual Speech Recognition—0
Leveraging Large Language Models in Visual Speech Recognition: Model Scaling, Context-Aware Decoding, and Iterative Polishing—0
CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge—0
Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign LanguageCode0
The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition—0
Scaling and Enhancing LLM-based AVSR: A Sparse Mixture of Projectors Approach—0
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer—0
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative SynchronizationCode2
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides—0
Visual-Aware Speech Recognition for Noisy Scenarios—0
MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech TokensCode1
Adaptive Audio-Visual Speech Recognition via Matryoshka-Based Multimodal LLMs—0
Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech RepresentationsCode1
NaturalL2S: End-to-End High-quality Multispeaker Lip-to-Speech Synthesis with Differential Digital Signal Processing—0
MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognition—0
Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation ModelsCode1
Lightweight Operations for Visual Speech Recognition—0
mWhisper-Flamingo for Multilingual Audio-Visual Noise-Robust Speech RecognitionCode3
Adapter-Based Multi-Agent AVSR Extension for Pre-Trained ASR Models—0
Evaluation of End-to-End Continuous Spanish Lipreading in Different Data ConditionsCode0
Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech RepresentationCode1
LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition—0
Listening and Seeing Again: Generative Error Correction for Audio-Visual Speech RecognitionCode0
Uncovering the Visual Contribution in Audio-Visual Speech Recognition—0
AlignVSR: Audio-Visual Cross-Modal Alignment for Visual Speech RecognitionCode1
Quantitative Analysis of Audio-Visual Tasks: An Information-Theoretic Perspective—0
Large Language Models are Strong Audio-Visual Speech Recognition LearnersCode2
Enhancing CTC-Based Visual Speech Recognition—0
DCIM-AVSR : Efficient Audio-Visual Speech Recognition via Dual Conformer Interaction Module—0
The NPU-ASLP System Description for Visual Speech Recognition in CNVSRC 2024Code0
SynesLM: A Unified Approach for Audio-visual Speech Recognition and Translation via Language Model and Synthetic DataCode0
Tailored Design of Audio-Visual Speech Recognition Models using BranchformersCode1
Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech RecognitionCode1
MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization—0
SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token SynchronizationCode2
CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge—0
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and TranslationCode3
Watch Your Mouth: Silent Speech Recognition with Depth SensingCode1
Audio-Visual Speech Recognition based on Regulated Transformer and Spatio-Temporal Fusion Strategy for Driver Assistive SystemsCode0
Learn2Talk: 3D Talking Face Learns from 2D Talking Face—0
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception—0
Multilingual Audio-Visual Speech Recognition with Hybrid CTC/RNN-T Fast Conformer—0
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech RecognitionCode0
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition—0
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech ProcessingCode3
Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition—0
It's Never Too Late: Fusing Acoustic Information into Large Language Models for Automatic Speech RecognitionCode1
SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition—0
Show:102550
← PrevPage 1 of 4Next →
All datasetsLRS3-TEDLRS2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1VTP with more dataWord Error Rate (WER)30.7—Unverified
2CTC/AttentionWord Error Rate (WER)19.1—Unverified
#ModelMetricClaimedVerifiedStatus
1VTP with more dataWord Error Rate (WER)22.6—Unverified