SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 153 papers

TitleStatusHype
Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations—0
Learning From the Master: Distilling Cross-Modal Advanced Knowledge for Lip Reading—0
LiRA: Learning Visual Speech Representations from Audio through Self-supervision—0
Multi-Perspective LSTM for Joint Visual Representation LearningCode0
End-to-End Video-To-Speech Synthesis using Generative Adversarial Networks—0
Fusing information streams in end-to-end audio-visual speech recognition—0
Lip reading using external viseme decoding—0
Contrastive Self-Supervised Learning of Global-Local Audio-Visual Representations—0
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention—0
AuthNet: A Deep Learning based Authentication Mechanism using Temporal Facial Feature MovementsCode0
Disentangling Homophemes in Lip Reading using Perplexity Analysis—0
A Study on Lip Localization Techniques used for Lip reading from a Video—0
Synchronous Bidirectional Learning for Multilingual Lip ReadingCode0
Seeing voices and hearing voices: learning discriminative embeddings using cross-modal self-supervision—0
Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading—0
Re-synchronization using the Hand Preceding Model for Multi-modal Fusion in Automatic Continuous Cued Speech Recognition—0
ASR is all you need: cross-modal distillation for lip reading—0
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers—0
Towards Pose-invariant Lip-Reading—0
Spatio-Temporal Fusion Based Convolutional Sequence Learning for Lip Reading—0
Multi-Grained Spatio-temporal Modeling for Lip-reading—0
A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading—0
Realistic Speech-Driven Facial Animation with GANs—0
MobiVSR: A Visual Speech Recognition Solution for Mobile Devices—0
Synthesising 3D Facial Motion from "In-the-Wild" Speech—0
Learning from Videos with Deep Convolutional LSTM Networks—0
An Empirical Analysis of Deep Audio-Visual Models for Speech Recognition—0
LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the WildCode0
Contextual Audio-Visual Switching For Speech Enhancement in Real-World Environments—0
Lip-Reading Driven Deep Learning Approach for Speech Enhancement—0
Talking Face Generation by Adversarially Disentangled Audio-Visual RepresentationCode0
Deep Lip Reading: a comparison of models and an online application—0
Lip Reading Using Convolutional Auto Encoders as Feature Extractor—0
Resource aware design of a deep convolutional-recurrent neural network for speech recognition through audio-visual sensor fusion—0
Deep Learning for Lip Reading using Audio-Visual Information for Urdu Language—0
Lip2AudSpec: Speech reconstruction from silent lip movements videoCode0
Which phoneme-to-viseme maps best improve visual-only computer lip-reading?—0
Resolution limits on visual speech recognition—0
Decoding visemes: improving machine lipreading—0
Finding phonemes: improving machine lip-reading—0
Speaker-independent machine lip-reading with speaker-dependent viseme classifiers—0
Some observations on computer lip-reading: moving from the dream to the reality—0
XFlow: Cross-modal Deep Neural Networks for Audiovisual ClassificationCode0
Estimating speech from lip dynamicsCode0
Towards Estimating the Upper Bound of Visual-Speech Recognition: The Visual Lip-Reading Feasibility Database—0
Automatic Viseme Vocabulary Construction to Enhance Continuous Lip-reading—0
Combining Residual Networks with LSTMs for LipreadingCode0
Lip Reading Sentences in the Wild—0
Video-Based Action Recognition Using Rate-Invariant Analysis of Covariance Trajectories—0
Definition of Visual Speech Element and Research on a Method of Extracting Feature Vector for Korean Lip-Reading—0
Show:102550
← PrevPage 3 of 4Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified