SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 153 papers

TitleStatusHype
Synthesising 3D Facial Motion from "In-the-Wild" Speech—0
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision—0
Towards Estimating the Upper Bound of Visual-Speech Recognition: The Visual Lip-Reading Feasibility Database—0
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale—0
Towards Pose-invariant Lip-Reading—0
VALLR: Visual ASR Language Model for Lip Reading—0
VCSE: Time-Domain Visual-Contextual Speaker Extraction Network—0
Video-Based Action Recognition Using Rate-Invariant Analysis of Covariance Trajectories—0
Visual Passwords Using Automatic Lip Reading—0
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis—0
Visual Speech Recognition—0
Visual Speech Recognition in a Driver Assistance System—0
Visual Words for Automatic Lip-Reading—0
Which phoneme-to-viseme maps best improve visual-only computer lip-reading?—0
Word-level Persian Lipreading Dataset—0
Neuromorphic Facial Analysis with Cross-Modal Supervision—0
Perception Point: Identifying Critical Learning Periods in Speech for Bilingual Networks—0
PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors—0
Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading—0
Quantitative Analysis of Audio-Visual Tasks: An Information-Theoretic Perspective—0
RAL:Redundancy-Aware Lipreading Model Based on Differential Learning with Symmetric Views—0
Realistic Speech-Driven Facial Animation with GANs—0
Resolution limits on visual speech recognition—0
Resource aware design of a deep convolutional-recurrent neural network for speech recognition through audio-visual sensor fusion—0
Re-synchronization using the Hand Preceding Model for Multi-modal Fusion in Automatic Continuous Cued Speech Recognition—0
Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach—0
A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading—0
Seeing voices and hearing voices: learning discriminative embeddings using cross-modal self-supervision—0
SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory—0
Some observations on computer lip-reading: moving from the dream to the reality—0
Spatio-Temporal Attention Mechanism and Knowledge Distillation for Lip Reading—0
Spatio-Temporal Fusion Based Convolutional Sequence Learning for Lip Reading—0
Spatio-temporal Transformers for Action Unit Classification with Event Cameras—0
MTGA: Multi-View Temporal Granularity Aligned Aggregation for Event-Based Lip-ReadingCode0
Multi-Perspective LSTM for Joint Visual Representation LearningCode0
LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the WildCode0
Lip Sync Matters: A Novel Multimodal Forgery DetectorCode0
Talking Face Generation by Adversarially Disentangled Audio-Visual RepresentationCode0
Lip2AudSpec: Speech reconstruction from silent lip movements videoCode0
Lend a Hand: Semi Training-Free Cued Speech Recognition via MLLM-Driven Hand Modeling for Barrier-free CommunicationCode0
Hearing Lips: Improving Lip Reading by Distilling Speech RecognizersCode0
Learning Separable Hidden Unit Contributions for Speaker-Adaptive Lip-ReadingCode0
Estimating speech from lip dynamicsCode0
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial AnimationCode0
Combining Residual Networks with LSTMs for LipreadingCode0
Audio-Visual Speech Recognition based on Regulated Transformer and Spatio-Temporal Fusion Strategy for Driver Assistive SystemsCode0
XFlow: Cross-modal Deep Neural Networks for Audiovisual ClassificationCode0
Relaxed Attention for Transformer ModelsCode0
A Novel Interpretable and Generalizable Re-synchronization Model for Cued Speech based on a Multi-Cuer CorpusCode0
Synchronous Bidirectional Learning for Multilingual Lip ReadingCode0
Show:102550
← PrevPage 3 of 4Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified