SOTAVerified|Agents Browse Leaderboard About

Talking Head Generation

Talking head generation is the task of generating a talking face from a set of images of a person.

( Image credit: Few-Shot Adversarial Learning of Realistic Neural Talking Head Models )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 31–40 of 119 papers

Title	Date	Tasks	Status	Hype
Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation	Jun 2, 2023	3D Face AnimationTalking Head Generation	CodeCode Available	1
Face Animation with an Attribute-Guided Diffusion Model	Apr 6, 2023	3D Face ReconstructionAttribute	CodeCode Available	1
DisCoHead: Audio-and-Video-Driven Talking Head Generation by Disentangled Control of Head Pose and Facial Expressions	Mar 14, 2023	Talking Head Generation	CodeCode Available	1
Autoregressive GAN for Semantic Unconditional Head Motion Generation	Nov 2, 2022	Motion GenerationTalking Head Generation	CodeCode Available	1
Perceptual Conversational Head Generation with Regularized Driver and Enhanced Renderer	Jun 26, 2022	Talking Head Generation	CodeCode Available	1
AI-generated characters for supporting personalized learning and well-being	Dec 15, 2021	Face ReenactmentNeural Rendering	CodeCode Available	1
AnimeCeleb: Large-Scale Animation CelebHeads Dataset for Head Reenactment	Nov 15, 2021	ColorizationFace Reenactment	CodeCode Available	1
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion	Jul 20, 2021	Image GenerationTalking Head Generation	CodeCode Available	1
Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via Text	Jun 26, 2021	Talking Face GenerationTalking Head Generation	CodeCode Available	1
Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation	Apr 16, 2021	Face ModelRhythm	CodeCode Available	1

Show:10 25 50

← PrevPage 4 of 12Next →

All datasets VoxCeleb2 - 1-shot learning VoxCeleb1 - 1-shot learning VoxCeleb1 - 32-shot learning VoxCeleb1 - 8-shot learning VoxCeleb2 - 8-shot learning 100 sleep nights of 8 caregivers VoxCeleb2 - 32-shot learning

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Few-shot Adversarial Model	FID	48.5	—	Unverified
2	CainGAN	FID	35	—	Unverified
3	Fast Bi-layer Avatars (medium size)	CSIM	0.65	—	Unverified
4	First Order Motion Model (medium size)	CSIM	0.64	—	Unverified
5	Few-shot Vid-to-vid (medium size)	CSIM	0.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	X2Face	FID	45.8	—	Unverified
2	Few-shot Adversarial Model	FID	43	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	X2Face	FID	56.5	—	Unverified
2	Few-shot Adversarial Model	FID	29.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	X2Face	FID	51.5	—	Unverified
2	Few-shot Adversarial Model	FID	38	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Few-shot Adversarial Model	FID	42.2	—	Unverified
2	CainGAN	FID	24.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ashok	10%	12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Few-shot Adversarial Model	FID	30.6	—	Unverified