SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–10 of 153 papers

TitleStatusHype
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis—0
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer—0
Transforming faces into video stories -- VideoFace2.0Code0
Development and evaluation of a deep learning algorithm for German word recognition from lip movements—0
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides—0
VALLR: Visual ASR Language Model for Lip Reading—0
Lend a Hand: Semi Training-Free Cued Speech Recognition via MLLM-Driven Hand Modeling for Barrier-free CommunicationCode0
Integrating Persian Lip Reading in Surena-V Humanoid Robot for Human-Robot Interaction—0
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility—0
LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition—0
Show:102550
← PrevPage 1 of 16Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified