SOTAVerified

Talking Face Generation

Talking face generation aims to synthesize a sequence of face images that correspond to given speech semantics

( Image credit: Talking Face Generation by Adversarially Disentangled Audio-Visual Representation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 110 papers

TitleStatusHype
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text—0
SPEAK: Speech-Driven Pose and Emotion-Adjustable Talking Head Generation—0
SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space—0
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation—0
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting—0
Superior and Pragmatic Talking Face Generation with Teacher-Student Framework—0
FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization—0
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style—0
G4G:A Generic Framework for High Fidelity Talking Face Generation with Fine-grained Intra-modal Alignment—0
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation—0
EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation—0
EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model—0
DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation—0
VectorTalker: SVG Talking Face Generation with Progressive Vectorisation—0
GSmoothFace: Generalized Smooth Talking Face Generation via Fine Grained 3D Face GuidanceCode0
FT2TF: First-Person Statement Text-To-Talking Face Generation—0
CP-EB: Talking Face Generation with Controllable Pose and Eye Blinking Embedding—0
ToonTalker: Cross-Domain Face Reenactment—0
VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer—0
Audio-driven Talking Face Generation with Stabilized Synchronization Loss—0
FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction—0
Instruct-NeuralTalker: Editing Audio-Driven Talking Radiance Fields with Instructions—0
Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation—0
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation—0
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning—0
Multimodal-driven Talking Face Generation via a Unified Diffusion-based Generator—0
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation—0
Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations—0
That's What I Said: Fully-Controllable Talking Face Generation—0
A Unified Compression Framework for Efficient Speech-Driven Talking-Face Generation—0
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder—0
UniFLG: Unified Facial Landmark Generator from Text or Speech—0
Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation—0
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation—0
LipFormer: High-Fidelity and Generalizable Talking Face Generation With a Pre-Learned Facial Codebook—0
Emotional Talking Faces: Making Videos More Expressive and Realistic—0
Memories are One-to-Many Mapping Alleviators in Talking Face Generation—0
SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory—0
Taiwanese-Accented Mandarin and English Multi-Speaker Talking-Face Synthesis System—0
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation—0
Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs—0
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model—0
One-Shot Face Reenactment on Megapixels—0
Talking Face Generation with Multilingual TTS—0
Emotion-Controllable Generalized Talking Face Generation—0
An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detection—0
Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild—0
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning—0
Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor—0
3D-TalkEmo: Learning to Synthesize 3D Emotional Talking Head—0
Show:102550
← PrevPage 2 of 3Next →
All datasetsCREMA-DLRW

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1EmoGenEmoAcc83.2—Unverified
#ModelMetricClaimedVerifiedStatus
1LipGANLMD0.6—Unverified