SOTAVerified

Talking Face Generation

Talking face generation aims to synthesize a sequence of face images that correspond to given speech semantics

( Image credit: Talking Face Generation by Adversarially Disentangled Audio-Visual Representation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 110 papers

TitleStatusHype
SegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing—0
Sonic: Shifting Focus to Global Audio Perception in Portrait Animation—0
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation—0
Style2Talker: High-Resolution Talking Head Generation with Emotion Style and Art Style—0
StyleTalk++: A Unified Framework for Controlling the Speaking Styles of Talking Heads—0
Superior and Pragmatic Talking Face Generation with Teacher-Student Framework—0
SwapTalk: Audio-Driven Talking Face Generation with One-Shot Customization in Latent Space—0
SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory—0
Taiwanese-Accented Mandarin and English Multi-Speaker Talking-Face Synthesis System—0
Talking Face Generation with Multilingual TTS—0
That's What I Said: Fully-Controllable Talking Face Generation—0
ToonTalker: Cross-Domain Face Reenactment—0
UniFLG: Unified Facial Landmark Generator from Text or Speech—0
UniSync: A Unified Framework for Audio-Visual Synchronization—0
VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer—0
VectorTalker: SVG Talking Face Generation with Progressive Vectorisation—0
VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization—0
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes—0
An Audio-Visual Attention Based Multimodal Network for Fake Talking Face Videos Detection—0
Attention-Based Lip Audio-Visual Synthesis for Talking Face Generation in the Wild—0
Audio-Driven Talking Face Generation with Diverse yet Realistic Facial Animations—0
Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluation—0
A Unified Compression Framework for Efficient Speech-Driven Talking-Face Generation—0
AVI-Talking: Learning Audio-Visual Instructions for Expressive 3D Talking Face Generation—0
CP-EB: Talking Face Generation with Controllable Pose and Eye Blinking Embedding—0
CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation—0
Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs—0
DAE-Talker: High Fidelity Speech-Driven Talking Face Generation with Diffusion Autoencoder—0
Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation—0
DisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model—0
DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation—0
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model—0
EMMN: Emotional Motion Memory Network for Audio-driven Emotional Talking Face Generation—0
EmoSpeaker: One-shot Fine-grained Emotion-Controlled Talking Face Generation—0
EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model—0
Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation—0
Emotional Talking Faces: Making Videos More Expressive and Realistic—0
Emotion-Controllable Generalized Talking Face Generation—0
Exploring Phonetic Context-Aware Lip-Sync For Talking Face Generation—0
Faces that Speak: Jointly Synthesising Talking Face and Speech from Text—0
FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization—0
FT2TF: First-Person Statement Text-To-Talking Face Generation—0
FTFDNet: Learning to Detect Talking Face Video Manipulation with Tri-Modality Interaction—0
G4G:A Generic Framework for High Fidelity Talking Face Generation with Fine-grained Intra-modal Alignment—0
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation—0
GLCF: A Global-Local Multimodal Coherence Analysis Framework for Talking Face Generation Detection—0
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting—0
Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss—0
High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model—0
High-fidelity Generalized Emotional Talking Face Generation with Multi-modal Emotion Space Learning—0
Show:102550
← PrevPage 2 of 3Next →
All datasetsCREMA-DLRW

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1EmoGenEmoAcc83.2—Unverified
#ModelMetricClaimedVerifiedStatus
1LipGANLMD0.6—Unverified