SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 153 papers

TitleStatusHype
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face SynthesisCode4
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech ProcessingCode3
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster PredictionCode2
Training Strategies for Improved Lip-readingCode2
Seeing What You Said: Talking Face Generation Guided by a Lip Reading ExpertCode2
OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality AlignmentCode1
Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realismCode1
Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and LanguageCode1
LipVoicer: Generating Speech from Silent Videos Guided by Lip ReadingCode1
Learn an Effective Lip Reading Model without PainsCode1
Lipreading using Temporal Convolutional NetworksCode1
Mutual Information Maximization for Effective Lip ReadingCode1
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech RecognitionCode1
OLKAVS: An Open Large-Scale Korean Audio-Visual Speech DatasetCode1
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and RecognitionCode1
Do VSR Models Generalize Beyond LRS3?Code1
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip ReadingCode1
Deep Audio-Visual Speech RecognitionCode1
End-to-End Speech-Driven Facial Animation with Temporal GANsCode1
End-to-end Audio-visual Speech Recognition with ConformersCode1
Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech RecognitionCode1
Contrastive Learning of Global-Local Video RepresentationsCode1
Audio-Visual Efficient Conformer for Robust Speech RecognitionCode1
Learning Individual Speaking Styles for Accurate Lip to Speech SynthesisCode1
Deformation Flow Based Two-Stream Network for Lip ReadingCode1
Show:102550
← PrevPage 1 of 7Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified