SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 71–80 of 153 papers

TitleStatusHype
A Multimodal German Dataset for Automatic Lip Reading Systems and Transfer Learning—0
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech RecognitionCode1
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster PredictionCode2
Multi-Grained Spatio-Temporal Features Perceived Network for Event-Based Lip-Reading—0
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading—0
Audio-Visual Synchronisation in the wild—0
Contrastive Learning of Global and Local Video Representations—0
Leveraging Uni-Modal Self-Supervised Learning for Multimodal Audio-visual Speech Recognition—0
Visual Keyword Spotting with AttentionCode1
Advances and Challenges in Deep Lip Reading—0
Show:102550
← PrevPage 8 of 16Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified