SOTAVerified

Lip Reading

Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.

Source: Mutual Information Maximization for Effective Lip Reading

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 153 papers

TitleStatusHype
LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition—0
Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models—0
Lip-Reading Driven Deep Learning Approach for Speech Enhancement—0
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge—0
Lip Reading Sentences in the Wild—0
Lip Reading Using Convolutional Auto Encoders as Feature Extractor—0
Lip reading using external viseme decoding—0
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention—0
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading—0
LiRA: Learning Visual Speech Representations from Audio through Self-supervision—0
LRWR: Large-Scale Benchmark for Lip Reading in Russian language—0
MobiVSR: A Visual Speech Recognition Solution for Mobile Devices—0
Multi-Grained Spatio-Temporal Features Perceived Network for Event-Based Lip-Reading—0
Multi-Grained Spatio-temporal Modeling for Lip-reading—0
RUSAVIC Corpus: Russian Audio-Visual Speech in Cars—0
Adaptive Semantic-Spatio-Temporal Graph Convolutional Network for Lip Reading—0
Advances and Challenges in Deep Lip Reading—0
A large-scale multimodal dataset of human speech recognition—0
A Multimodal German Dataset for Automatic Lip Reading Systems and Transfer Learning—0
A Multi-Purpose Audio-Visual Corpus for Multi-Modal Persian Speech Recognition: the Arman-AV Dataset—0
An Empirical Analysis of Deep Audio-Visual Models for Speech Recognition—0
A Novel Frame Structure for Cloud-Based Audio-Visual Speech Enhancement in Multimodal Hearing-aids—0
ASR is all you need: cross-modal distillation for lip reading—0
A Study on Lip Localization Techniques used for Lip reading from a Video—0
Audio-Visual Speech and Gesture Recognition by Sensors of Mobile Devices—0
Audio-Visual Speech Enhancement and Separation by Utilizing Multi-Modal Self-Supervised Embeddings—0
Audio-Visual Speech Recognition is Worth 32328 Voxels—0
Audio-Visual Synchronisation in the wild—0
Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss—0
Automatic Viseme Vocabulary Construction to Enhance Continuous Lip-reading—0
Bridge to Non-Barrier Communication: Gloss-Prompted Fine-grained Cued Speech Gesture Generation with Diffusion Model—0
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides—0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
Computation and Parameter Efficient Multi-Modal Fusion Transformer for Cued Speech Recognition—0
Contextual Audio-Visual Switching For Speech Enhancement in Real-World Environments—0
Contrastive Learning of Global and Local Video Representations—0
Contrastive Self-Supervised Learning of Global-Local Audio-Visual Representations—0
Cross-Attention Fusion of Visual and Geometric Features for Large Vocabulary Arabic Lipreading—0
Decoding visemes: improving machine lipreading—0
Deep Learning-based Spatio Temporal Facial Feature Visual Speech Recognition—0
Deep Learning for Lip Reading using Audio-Visual Information for Urdu Language—0
Deep Lip Reading: a comparison of models and an online application—0
Definition of Visual Speech Element and Research on a Method of Extracting Feature Vector for Korean Lip-Reading—0
Development and evaluation of a deep learning algorithm for German word recognition from lip movements—0
Disentangling Homophemes in Lip Reading using Perplexity Analysis—0
Speaker-independent machine lip-reading with speaker-dependent viseme classifiers—0
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model—0
Streaming Audio-Visual Speech Recognition with Alignment Regularization—0
Sub-word Level Lip Reading With Visual Attention—0
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer—0
Show:102550
← PrevPage 2 of 4Next →
All datasetsGRID corpus (mixed-speech)LRWTCD-TIMIT corpus (mixed-speech)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Lip2WavWER14.08—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER34.2—Unverified
#ModelMetricClaimedVerifiedStatus
1Lip2WavWER31.26—Unverified