SOTAVerified

Talking Face Generation

Talking face generation aims to synthesize a sequence of face images that correspond to given speech semantics

( Image credit: Talking Face Generation by Adversarially Disentangled Audio-Visual Representation )

Papers

Showing 2650 of 110 papers

TitleStatusHype
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual RepresentationCode1
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel’s Weekly Video PodcastsCode1
FNeVR: Neural Volume Rendering for Face AnimationCode1
MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face GenerationCode1
Flow-Guided One-Shot Talking Face Generation With a High-Resolution Audio-Visual DatasetCode1
Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with AdaptersCode1
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute LearningCode1
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video PodcastsCode1
DiffDub: Person-generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-encoderCode1
Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose DictionaryCode1
Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation0
Emotion-Controllable Generalized Talking Face Generation0
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder0
Emotional Talking Faces: Making Videos More Expressive and Realistic0
Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs0
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation0
Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation0
EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model0
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation0
EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation0
Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning0
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning0
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation0
CP-EB: Talking Face Generation with Controllable Pose and Eye Blinking Embedding0
Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations0
Show:102550
← PrevPage 2 of 5Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1EmoGenEmoAcc83.2Unverified
#ModelMetricClaimedVerifiedStatus
1LipGANLMD0.6Unverified