SOTAVerified|Agents Browse Leaderboard About

Talking Head Generation

Talking head generation is the task of generating a talking face from a set of images of a person.

( Image credit: Few-Shot Adversarial Learning of Realistic Neural Talking Head Models )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 101–110 of 119 papers

Title	Date	Tasks	Status	Hype
Synthesizing Photorealistic Virtual Humans Through Cross-modal Disentanglement	Sep 3, 2022	Data AugmentationDisentanglement	—Unverified	0
StyleTalker: One-shot Style-based Audio-driven Talking Head Video Generation	Aug 23, 2022	Talking Head GenerationVideo Generation	—Unverified	0
One-Shot Face Reenactment on Megapixels	May 26, 2022	Face GenerationFace Reenactment	—Unverified	0
Talking Head Generation Driven by Speech-Related Facial Action Units and Audio- Based on Multimodal Representation Fusion	Apr 27, 2022	Talking Head Generation	—Unverified	0
DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generation	Mar 15, 2022	NeRFTalking Head Generation	—Unverified	0
Towards Realistic Visual Dubbing with Heterogeneous Sources	Jan 17, 2022	DisentanglementTalking Head Generation	—Unverified	0
DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering	Jan 3, 2022	NeRFNeural Rendering	—Unverified	0
Expressive Talking Head Generation With Granular Audio-Visual Control	Jan 1, 2022	Talking Head Generation	—Unverified	0
Responsive Listening Head Generation: A Benchmark Dataset and Baseline	Dec 27, 2021	Talking Head GenerationTranslation	—Unverified	0
Talking Head Generation with Audio and Speech Related Facial Action Units	Oct 19, 2021	Talking Head Generation	—Unverified	0

Show:10 25 50

← PrevPage 11 of 12Next →

All datasets VoxCeleb2 - 1-shot learning VoxCeleb1 - 1-shot learning VoxCeleb1 - 32-shot learning VoxCeleb1 - 8-shot learning VoxCeleb2 - 8-shot learning 100 sleep nights of 8 caregivers VoxCeleb2 - 32-shot learning

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Few-shot Adversarial Model	FID	48.5	—	Unverified
2	CainGAN	FID	35	—	Unverified
3	Fast Bi-layer Avatars (medium size)	CSIM	0.65	—	Unverified
4	First Order Motion Model (medium size)	CSIM	0.64	—	Unverified
5	Few-shot Vid-to-vid (medium size)	CSIM	0.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	X2Face	FID	45.8	—	Unverified
2	Few-shot Adversarial Model	FID	43	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	X2Face	FID	56.5	—	Unverified
2	Few-shot Adversarial Model	FID	29.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	X2Face	FID	51.5	—	Unverified
2	Few-shot Adversarial Model	FID	38	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Few-shot Adversarial Model	FID	42.2	—	Unverified
2	CainGAN	FID	24.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ashok	10%	12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Few-shot Adversarial Model	FID	30.6	—	Unverified