SOTAVerified

Visual Speech Recognition

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 182 papers

TitleStatusHype
Leveraging Large Language Models in Visual Speech Recognition: Model Scaling, Context-Aware Decoding, and Iterative Polishing—0
CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge—0
Scaling and Enhancing LLM-based AVSR: A Sparse Mixture of Projectors Approach—0
Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign LanguageCode0
The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition—0
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer—0
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides—0
Visual-Aware Speech Recognition for Noisy Scenarios—0
Adaptive Audio-Visual Speech Recognition via Matryoshka-Based Multimodal LLMs—0
NaturalL2S: End-to-End High-quality Multispeaker Lip-to-Speech Synthesis with Differential Digital Signal Processing—0
MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognition—0
Lightweight Operations for Visual Speech Recognition—0
Adapter-Based Multi-Agent AVSR Extension for Pre-Trained ASR Models—0
Evaluation of End-to-End Continuous Spanish Lipreading in Different Data ConditionsCode0
LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition—0
Listening and Seeing Again: Generative Error Correction for Audio-Visual Speech RecognitionCode0
Uncovering the Visual Contribution in Audio-Visual Speech Recognition—0
Quantitative Analysis of Audio-Visual Tasks: An Information-Theoretic Perspective—0
Enhancing CTC-Based Visual Speech Recognition—0
DCIM-AVSR : Efficient Audio-Visual Speech Recognition via Dual Conformer Interaction Module—0
The NPU-ASLP System Description for Visual Speech Recognition in CNVSRC 2024Code0
SynesLM: A Unified Approach for Audio-visual Speech Recognition and Translation via Language Model and Synthetic DataCode0
MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization—0
CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge—0
Audio-Visual Speech Recognition based on Regulated Transformer and Spatio-Temporal Fusion Strategy for Driver Assistive SystemsCode0
Learn2Talk: 3D Talking Face Learns from 2D Talking Face—0
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception—0
Multilingual Audio-Visual Speech Recognition with Hybrid CTC/RNN-T Fast Conformer—0
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech RecognitionCode0
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition—0
Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition—0
SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition—0
MLCA-AVSR: Multi-Layer Cross Attention Fusion based Audio-Visual Speech Recognition—0
Multichannel AV-wav2vec2: A Framework for Learning Multichannel Multi-Modal Speech RepresentationCode0
LiteVSR: Efficient Visual Speech Recognition by Learning from Speech Representations of Unlabeled Data—0
The GUA-Speech System Description for CNVSRC Challenge 2023—0
Speaker-Adapted End-to-End Visual Speech Recognition for Continuous Spanish—0
Analysis of Visual Features for Continuous Lipreading in Spanish—0
LIP-RTVE: An Audiovisual Database for Continuous Spanish in the WildCode0
End-to-End Lip Reading in Romanian with Cross-Lingual Domain Adaptation and Lateral Inhibition—0
AV-CPL: Continuous Pseudo-Labeling for Audio-Visual Speech Recognition—0
The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction—0
Another Point of View on Visual Speech Recognition—0
AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model—0
Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping—0
SparseVSR: Lightweight and Noise Robust Visual Speech Recognition—0
Automated Speaker Independent Visual Speech Recognition: A Comprehensive Survey—0
Improving the Gap in Visual Speech Recognition Between Normal and Silent Speech Based on Metric Learning—0
Multi-Temporal Lip-Audio Memory for Visual Speech Recognition—0
Deep Learning-based Spatio Temporal Facial Feature Visual Speech Recognition—0
Show:102550
← PrevPage 2 of 4Next →
All datasetsLRS3-TEDLRS2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1VTP with more dataWord Error Rate (WER)30.7—Unverified
2CTC/AttentionWord Error Rate (WER)19.1—Unverified
#ModelMetricClaimedVerifiedStatus
1VTP with more dataWord Error Rate (WER)22.6—Unverified