SOTAVerified

Talking Face Generation

Talking face generation aims to synthesize a sequence of face images that correspond to given speech semantics

( Image credit: Talking Face Generation by Adversarially Disentangled Audio-Visual Representation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 110 papers

TitleStatusHype
Identity-Preserving Talking Face Generation with Landmark and Appearance PriorsCode2
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning—0
Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator—0
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation—0
Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations—0
That's What I Said: Fully-Controllable Talking Face Generation—0
A Unified Compression Framework for Efficient Speech-Driven Talking-Face Generation—0
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder—0
Seeing What You Said: Talking Face Generation Guided by a Lip Reading ExpertCode2
Emotionally Enhanced Talking Face GenerationCode2
DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution VideoCode3
UniFLG: Unified Facial Landmark Generator from Text or Speech—0
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face SynthesisCode4
DPE: Disentanglement of Pose and Expression for General Video Portrait EditingCode2
Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation—0
StyleTalk: One-shot Talking Head Generation with Controllable Speaking StylesCode2
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation—0
LipFormer: High-Fidelity and Generalizable Talking Face Generation With a Pre-Learned Facial Codebook—0
Emotional Talking Faces: Making Videos More Expressive and Realistic—0
Memories are One-to-Many Mapping Alleviators in Talking Face Generation—0
Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial DecompositionCode2
SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory—0
Taiwanese-Accented Mandarin and English Multi-Speaker Talking-Face Synthesis System—0
FNeVR: Neural Volume Rendering for Face AnimationCode1
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation—0
Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head SynthesisCode2
Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs—0
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel’s Weekly Video PodcastsCode1
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model—0
One-Shot Face Reenactment on Megapixels—0
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video PodcastsCode1
Talking Face Generation with Multilingual TTS—0
Emotion-Controllable Generalized Talking Face Generation—0
An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detection—0
Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild—0
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANCode2
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning—0
Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor—0
Live Speech Portraits: Real-Time Photorealistic Talking-Head AnimationCode2
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute LearningCode1
Parallel and High-Fidelity Text-to-Lip GenerationCode1
Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via TextCode1
Flow-Guided One-Shot Talking Face Generation With a High-Resolution Audio-Visual DatasetCode1
Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose DictionaryCode1
3D-TalkEmo: Learning to Synthesize 3D Emotional Talking Head—0
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual RepresentationCode1
AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head SynthesisCode0
Stochastic Talking Face Generation Using Latent Distribution MatchingCode0
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The WildCode3
Speech Driven Talking Face Generation from a Single Image and an Emotion ConditionCode1
Show:102550
← PrevPage 2 of 3Next →
All datasetsCREMA-DLRW

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1EmoGenEmoAcc83.2—Unverified
#ModelMetricClaimedVerifiedStatus
1LipGANLMD0.6—Unverified