SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 71–80 of 153 papers

TitleStatusHype
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model—0
Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss—0
Lip Sync Matters: A Novel Multimodal Forgery DetectorCode0
Streaming Audio-Visual Speech Recognition with Alignment Regularization—0
Audio-Visual Speech Enhancement and Separation by Utilizing Multi-Modal Self-Supervised Embeddings—0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
A Novel Frame Structure for Cloud-Based Audio-Visual Speech Enhancement in Multimodal Hearing-aids—0
VCSE: Time-Domain Visual-Contextual Speaker Extraction Network—0
Relaxed Attention for Transformer Models—0
Visual Speech Recognition in a Driver Assistance System—0
Show:102550
← PrevPage 8 of 16Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified