SOTAVerified

Talking Face Generation

Talking face generation aims to synthesize a sequence of face images that correspond to given speech semantics

( Image credit: Talking Face Generation by Adversarially Disentangled Audio-Visual Representation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 110 papers

TitleStatusHype
Real3D-Portrait: One-shot Realistic 3D Talking Portrait SynthesisCode5
Deepfake Generation and Detection: A Benchmark and SurveyCode4
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face SynthesisCode4
A Lip Sync Expert Is All You Need for Speech to Lip Generation In The WildCode3
DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution VideoCode3
JoyGen: Audio-Driven 3D Depth-Aware Talking-Face Video EditingCode3
SyncTalk: The Devil is in the Synchronization for Talking Head SynthesisCode3
DPE: Disentanglement of Pose and Expression for General Video Portrait EditingCode2
StyleTalk: One-shot Talking Head Generation with Controllable Speaking StylesCode2
Seeing What You Said: Talking Face Generation Guided by a Lip Reading ExpertCode2
Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial DecompositionCode2
HyperLips: Hyper Control Lips with High Resolution Decoder for Talking Face GenerationCode2
Emotionally Enhanced Talking Face GenerationCode2
Live Speech Portraits: Real-Time Photorealistic Talking-Head AnimationCode2
MakeItTalk: Speaker-Aware Talking-Head AnimationCode2
Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head SynthesisCode2
Identity-Preserving Talking Face Generation with Landmark and Appearance PriorsCode2
StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANCode2
Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via TextCode1
Parallel and High-Fidelity Text-to-Lip GenerationCode1
KAN-Based Fusion of Dual-Domain for Audio-Driven Facial Landmarks GenerationCode1
Speech Driven Talking Face Generation from a Single Image and an Emotion ConditionCode1
HDTR-Net: A Real-Time High-Definition Teeth Restoration Network for Arbitrary Talking Face Generation MethodsCode1
Controllable Talking Face Generation by Implicit Facial Keypoints EditingCode1
Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realismCode1
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual RepresentationCode1
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel’s Weekly Video PodcastsCode1
FNeVR: Neural Volume Rendering for Face AnimationCode1
MEAD: A Large-scale Audio-visual Dataset for Emotional Talking-face GenerationCode1
Flow-Guided One-Shot Talking Face Generation With a High-Resolution Audio-Visual DatasetCode1
Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with AdaptersCode1
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute LearningCode1
Merkel Podcast Corpus: A Multimodal Dataset Compiled from 16 Years of Angela Merkel's Weekly Video PodcastsCode1
DiffDub: Person-generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-encoderCode1
Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose DictionaryCode1
Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation—0
Emotion-Controllable Generalized Talking Face Generation—0
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder—0
Emotional Talking Faces: Making Videos More Expressive and Realistic—0
Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs—0
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation—0
Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation—0
EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model—0
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation—0
EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation—0
Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning—0
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning—0
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation—0
CP-EB: Talking Face Generation with Controllable Pose and Eye Blinking Embedding—0
Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations—0
Show:102550
← PrevPage 1 of 3Next →
All datasetsCREMA-DLRW

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1EmoGenEmoAcc83.2—Unverified
#ModelMetricClaimedVerifiedStatus
1LipGANLMD0.6—Unverified