SOTAVerified

3D Face Reconstruction

3D Face Reconstruction is a computer vision task that involves creating a 3D model of a human face from a 2D image or a set of images. The goal of 3D face reconstruction is to reconstruct a digital 3D representation of a person's face, which can be used for various applications such as animation, virtual reality, and biometric identification.

( Image credit: 3DDFA_V2 )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 211 papers

TitleStatusHype
3D Facial Expressions through Analysis-by-Neural-SynthesisCode3
FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid DatasetCode2
FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face ReconstructionCode2
HairMapper: Removing Hair From Portraits Using GANsCode2
Towards Realistic Generative 3D Face ModelsCode2
Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from VideosCode2
3D Face Reconstruction with the Geometric Guidance of Facial Part SegmentationCode2
REALY: Rethinking the Evaluation of 3D Face ReconstructionCode2
RetinaFace: Single-Shot Multi-Level Face Localisation in the WildCode2
Towards Fast, Accurate and Stable 3D Dense Face AlignmentCode2
Learning a model of facial shape and expression from 4D scansCode2
A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild ImagesCode2
Learning an Animatable Detailed 3D Face Model from In-The-Wild ImagesCode2
EMOCA: Emotion Driven Monocular Face Capture and AnimationCode2
Towards Metrical Reconstruction of Human FacesCode2
KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of KeypointsCode2
3D-GANTex: 3D Face Reconstruction with StyleGAN3-based Multi-View Images and 3DDFA based Mesh GenerationCode2
Self-Supervised Robustifying Guidance for Monocular 3D Face ReconstructionCode1
Self-supervised Re-renderable Facial Albedo Reconstruction from Single ImageCode1
Towards 3D Face Reconstruction in Perspective Projection: Estimating 6DoF Face Pose from Monocular ImageCode1
SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and ReconstructionCode1
Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression NetworkCode1
Instant Multi-View Head Capture through Learnable RegistrationCode1
Lightweight Photometric Stereo for Facial Details RecoveryCode1
Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image SetCode1
Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric ModelCode1
3D Face From X: Learning Face Shape from Diverse SourcesCode1
Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial GeometryCode1
FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion ModelsCode1
Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry ConsistencyCode1
FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression EditingCode1
From 2D Images to 3D Model:Weakly Supervised Multi-View Face Reconstruction with Deep FusionCode1
AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANsCode1
FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face ReconstructionCode1
GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face ReconstructionCode1
Non-Deterministic Face Mask Removal Based On 3D PriorsCode1
PointNet: Deep Learning on Point Sets for 3D Classification and SegmentationCode1
DSFNet: Dual Space Fusion Network for Occlusion-Robust 3D Dense Face AlignmentCode1
Monocular Expressive Body Regression through Body-Driven AttentionCode1
Pre-training strategies and datasets for facial representation learningCode1
Deep Facial Non-Rigid Multi-View StereoCode1
AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"Code1
Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?Code1
Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face ReconstructionCode1
“Look Ma, no landmarks!” – Unsupervised, Model-based Dense Face AlignmentCode1
Beyond 3DMM Space: Towards Fine-grained 3D Face ReconstructionCode1
HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face SwappingCode1
Collaborative Regression of Expressive Bodies using ModerationCode1
Face Animation with an Attribute-Guided Diffusion ModelCode1
Cross-modal Deep Face Normals with Deactivable Skip ConnectionsCode1
Show:102550
← PrevPage 1 of 5Next →
All datasetsREALYREALY (side-view)NoW BenchmarkFlorenceAFLW2000-3DStirling-HQ (FG2018 3D face reconstruction challenge)Stirling-LQ (FG2018 3D face reconstruction challenge)13.8

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1N-3DMMall2.95—Unverified
2EMOCA-fall2.39—Unverified
3ExpNetall2.31—Unverified
4RingNetall2.26—Unverified
5DECA-fall2.21—Unverified
6MICAall2.13—Unverified
7EMOCA-call2.1—Unverified
8SynergyNetall2.02—Unverified
9CESTall2.02—Unverified
10PRNetall2.01—Unverified
#ModelMetricClaimedVerifiedStatus
1ExpNetall2.48—Unverified
2EMOCA-fall2.4—Unverified
3DECA-fall2.26—Unverified
4RingNetall2.26—Unverified
5MICAall2.15—Unverified
6EMOCA-call2.13—Unverified
7DECA-call2.11—Unverified
8PRNetall2.03—Unverified
9SynergyNetall2.01—Unverified
10SADRNetall1.96—Unverified
#ModelMetricClaimedVerifiedStatus
13DMM-CNNMedian Reconstruction Error1.84—Unverified
2UMDFAMedian Reconstruction Error1.52—Unverified
3PRNetMedian Reconstruction Error1.5—Unverified
4MGCNetMedian Reconstruction Error1.31—Unverified
5SynergyNetMedian Reconstruction Error1.27—Unverified
6Dib et al. 2021Median Reconstruction Error1.26—Unverified
7Deng et al. 2019Median Reconstruction Error1.23—Unverified
83DDFA_V2Median Reconstruction Error1.23—Unverified
9RingNetMedian Reconstruction Error1.21—Unverified
10FLAME templateMedian Reconstruction Error1.21—Unverified
#ModelMetricClaimedVerifiedStatus
13DDFAMean NME 6.38—Unverified
2VRN-GuidedMean NME 5.27—Unverified
3PRNMean NME 3.76—Unverified
43DDFA_V2Mean NME3.56—Unverified
5Tran et al.RMSE Cooperative1.97—Unverified
63DMM-CNNAverage 3D Error1.93—Unverified
7itwmmAverage 3D Error1.82—Unverified
8Genova et al.RMSE Cooperative1.78—Unverified
9Piotraschke and BlanzRMSE Cooperative1.68—Unverified
10Deep3DFaceReconstructionRMSE Cooperative1.66—Unverified
#ModelMetricClaimedVerifiedStatus
1DeFAMean NME 5.65—Unverified
23DDFAMean NME 5.37—Unverified
3PRNMean NME 3.96—Unverified
43DDFA-V2Mean NME 3.56—Unverified
5B-spline FFDMean NME 3.51—Unverified
6VGG-FMean NME 3.42—Unverified
7SADRNetMean NME 3.25—Unverified
8DSFNet-isMean NME3.16—Unverified
#ModelMetricClaimedVerifiedStatus
1PRNetMean Reconstruction Error (mm)2.06—Unverified
2RingNetMean Reconstruction Error (mm)2.02—Unverified
33DDFA_V2Mean Reconstruction Error (mm)1.91—Unverified
4DECAMean Reconstruction Error (mm)1.89—Unverified
#ModelMetricClaimedVerifiedStatus
1PRNetMean Reconstruction Error (mm)2.38—Unverified
23DDFA_V2Mean Reconstruction Error (mm)2.1—Unverified
3RingNetMean Reconstruction Error (mm)2.08—Unverified
4DECAMean Reconstruction Error (mm)1.91—Unverified
#ModelMetricClaimedVerifiedStatus
1Djehutynakht0..5sec0—Unverified