SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Showing 101110 of 153 papers

TitleStatusHype
Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations0
Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading0
LiRA: Learning Visual Speech Representations from Audio through Self-supervision0
Multi-Perspective LSTM for Joint Visual Representation LearningCode0
End-to-End Video-To-Speech Synthesis using Generative Adversarial Networks0
Fusing information streams in end-to-end audio-visual speech recognition0
Lip reading using external viseme decoding0
Contrastive Self-Supervised Learning of Global-Local Audio-Visual Representations0
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention0
AuthNet: A Deep Learning based Authentication Mechanism using Temporal Facial Feature MovementsCode0
Show:102550
← PrevPage 11 of 16Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26Unverified