SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 153 papers

TitleStatusHype
RUSAVIC Corpus: Russian Audio-Visual Speech in Cars—0
Seeing voices and hearing voices: learning discriminative embeddings using cross-modal self-supervision—0
SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory—0
Some observations on computer lip-reading: moving from the dream to the reality—0
Spatio-Temporal Attention Mechanism and Knowledge Distillation for Lip Reading—0
Spatio-Temporal Fusion Based Convolutional Sequence Learning for Lip Reading—0
Spatio-temporal Transformers for Action Unit Classification with Event Cameras—0
Speaker-independent machine lip-reading with speaker-dependent viseme classifiers—0
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model—0
Streaming Audio-Visual Speech Recognition with Alignment Regularization—0
Sub-word Level Lip Reading With Visual Attention—0
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer—0
Synthesising 3D Facial Motion from "In-the-Wild" Speech—0
A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading—0
Towards Estimating the Upper Bound of Visual-Speech Recognition: The Visual Lip-Reading Feasibility Database—0
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale—0
Towards Pose-invariant Lip-Reading—0
VALLR: Visual ASR Language Model for Lip Reading—0
VCSE: Time-Domain Visual-Contextual Speaker Extraction Network—0
Video-Based Action Recognition Using Rate-Invariant Analysis of Covariance Trajectories—0
Visual Passwords Using Automatic Lip Reading—0
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis—0
Visual Speech Recognition—0
Visual Speech Recognition in a Driver Assistance System—0
Visual Words for Automatic Lip-Reading—0
Show:102550
← PrevPage 4 of 7Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified