SOTAVerified

Visual Speech Recognition

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 182 papers

TitleStatusHype
Uncovering the Visual Contribution in Audio-Visual Speech Recognition—0
AlignVSR: Audio-Visual Cross-Modal Alignment for Visual Speech RecognitionCode1
Quantitative Analysis of Audio-Visual Tasks: An Information-Theoretic Perspective—0
Large Language Models are Strong Audio-Visual Speech Recognition LearnersCode2
Enhancing CTC-Based Visual Speech Recognition—0
DCIM-AVSR : Efficient Audio-Visual Speech Recognition via Dual Conformer Interaction Module—0
The NPU-ASLP System Description for Visual Speech Recognition in CNVSRC 2024Code0
SynesLM: A Unified Approach for Audio-visual Speech Recognition and Translation via Language Model and Synthetic DataCode0
Tailored Design of Audio-Visual Speech Recognition Models using BranchformersCode1
Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech RecognitionCode1
MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization—0
SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token SynchronizationCode2
CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge—0
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and TranslationCode3
Watch Your Mouth: Silent Speech Recognition with Depth SensingCode1
Audio-Visual Speech Recognition based on Regulated Transformer and Spatio-Temporal Fusion Strategy for Driver Assistive SystemsCode0
Learn2Talk: 3D Talking Face Learns from 2D Talking Face—0
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception—0
Multilingual Audio-Visual Speech Recognition with Hybrid CTC/RNN-T Fast Conformer—0
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech RecognitionCode0
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition—0
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech ProcessingCode3
Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition—0
It's Never Too Late: Fusing Acoustic Information into Large Language Models for Automatic Speech RecognitionCode1
SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition—0
Show:102550
← PrevPage 2 of 8Next →
All datasetsLRS3-TEDLRS2

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1VTP with more dataWord Error Rate (WER)30.7—Unverified
2CTC/AttentionWord Error Rate (WER)19.1—Unverified
#ModelMetricClaimedVerifiedStatus
1VTP with more dataWord Error Rate (WER)22.6—Unverified