SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 153 papers

TitleStatusHype
Exploring Lip Segmentation Techniques in Computer Vision: A Comparative Analysis—0
Expression-preserving face frontalization improves visually assisted speech processing—0
Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations—0
Finding phonemes: improving machine lip-reading—0
A Study on Lip Localization Techniques used for Lip reading from a Video—0
Bridge to Non-Barrier Communication: Gloss-Prompted Fine-grained Cued Speech Gesture Generation with Diffusion Model—0
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility—0
Contrastive Learning of Global and Local Video Representations—0
Integrating Persian Lip Reading in Surena-V Humanoid Robot for Human-Robot Interaction—0
Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization—0
ASR is all you need: cross-modal distillation for lip reading—0
Disentangling Homophemes in Lip Reading using Perplexity Analysis—0
Automatic Viseme Vocabulary Construction to Enhance Continuous Lip-reading—0
A Multimodal German Dataset for Automatic Lip Reading Systems and Transfer Learning—0
Lip Reading Sentences in the Wild—0
Development and evaluation of a deep learning algorithm for German word recognition from lip movements—0
A large-scale multimodal dataset of human speech recognition—0
Definition of Visual Speech Element and Research on a Method of Extracting Feature Vector for Korean Lip-Reading—0
Deep Lip Reading: a comparison of models and an online application—0
Leveraging Visemes for Better Visual Speech Representation and Lip Reading—0
Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss—0
Adaptive Semantic-Spatio-Temporal Graph Convolutional Network for Lip Reading—0
Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping—0
LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition—0
Lip-Reading Driven Deep Learning Approach for Speech Enhancement—0
Show:102550
← PrevPage 3 of 7Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified