Facial Expression Recognition (FER)

Facial Expression Recognition (FER) is a computer vision task aimed at identifying and categorizing emotional expressions depicted on a human face. The goal is to automate the process of determining emotions in real-time, by analyzing the various features of a face such as eyebrows, eyes, mouth, and other features, and mapping them to a set of emotions such as anger, fear, surprise, sadness and happiness.

( Image credit: DeXpression )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 51–75 of 492 papers

Title	Date	Tasks	Status	Hype
CAGE: Circumplex Affect Guided Expression Inference	Apr 23, 2024	Arousal EstimationDominance Estimation	CodeCode Available	1
LEAF: Unveiling Two Sides of the Same Coin in Semi-supervised Facial Expression Recognition	Apr 23, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	0
Cross-Task Multi-Branch Vision Transformer for Facial Expression and Mask Wearing Classification	Apr 22, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
eMotion-GAN: A Motion-based GAN for Photorealistic and Facial Expression Preserving Frontal View Synthesis	Apr 15, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	0
Dynamic Resolution Guidance for Facial Expression Recognition	Apr 9, 2024	Emotion RecognitionFacial Expression Recognition	—Unverified	0
Music Recommendation Based on Facial Emotion Recognition	Apr 6, 2024	Emotion ClassificationEmotion Recognition	—Unverified	0
Joint Training on Multiple Datasets With Inconsistent Labeling Criteria for Facial Expression Recognition	Apr 2, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	0
A Lightweight Attention-based Deep Network via Multi-Scale Feature Fusion for Multi-View Facial Expression Recognition	Mar 21, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	0
Emotic Masked Autoencoder with Attention Fusion for Facial Expression Recognition	Mar 19, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
Exploring Facial Expression Recognition through Semi-Supervised Pretraining and Temporal Modeling	Mar 18, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
DrFER: Learning Disentangled Representations for 3D Facial Expression Recognition	Mar 13, 2024	3D Facial Expression RecognitionDisentanglement	—Unverified	0
Towards Realistic Landmark-Guided Facial Video Inpainting Based on GANs	Feb 14, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
Guided Interpretable Facial Expression Recognition via Spatial Action Unit Cues	Feb 1, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1
LRDif: Diffusion Models for Under-Display Camera Emotion Recognition	Feb 1, 2024	Emotion RecognitionFacial Expression Recognition	—Unverified	0
Realtime Facial Expression Recognition: Neuromorphic Hardware vs. Edge AI Accelerators	Jan 30, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
Expression-aware video inpainting for HMD removal in XR applications	Jan 25, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	0
Open-Set Facial Expression Recognition	Jan 23, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
MIMIC: Mask Image Pre-training with Mix Contrastive Fine-tuning for Facial Expression Recognition	Jan 14, 2024	Contrastive LearningFace Recognition	—Unverified	0
Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyond	Jan 2, 2024	Action Unit DetectionFace Recognition	—Unverified	0
FER-C: Benchmarking Out-of-Distribution Soft Calibration for Facial Expression Recognition	Dec 16, 2023	BenchmarkingFacial Expression Recognition	—Unverified	0
Hypergraph-Guided Disentangled Spectrum Transformer Networks for Near-Infrared Facial Expression Recognition	Dec 10, 2023	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
Multi-Energy Guided Image Translation with Stochastic Differential Equations for Near-Infrared Facial Expression Recognition	Dec 10, 2023	Facial Expression RecognitionFacial Expression Recognition (FER)	—Unverified	0
From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos	Dec 9, 2023	Dynamic Facial Expression RecognitionFacial Expression Recognition	CodeCode Available	1
Subject-Based Domain Adaptation for Facial Expression Recognition	Dec 9, 2023	Domain AdaptationFacial Expression Recognition	CodeCode Available	0
QAFE-Net: Quality Assessment of Facial Expressions with Landmark Heatmaps	Dec 1, 2023	Action Quality AssessmentFacial Expression Recognition	CodeCode Available	1

Show:10 25 50

← PrevPage 3 of 20Next →

All datasets AffectNet RAF-DB FER2013 FER+Acted Facial Expressions In The Wild (AFEW)CK+FERPlus JAFFE SFEW Aff-Wild2 BP4D DISFA

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResEmoteNet	Accuracy (7 emotion)	72.93	—	Unverified
2	Norface	Accuracy (8 emotion)	68.69	—	Unverified
3	EmoAffectNet	Accuracy (7 emotion)	66.49	—	Unverified
4	Emotion-GCN	Accuracy (7 emotion)	66.46	—	Unverified
5	FaceBehaviorNet	Accuracy (7 emotion)	65.4	—	Unverified
6	Ada-DF	Accuracy (7 emotion)	65.34	—	Unverified
7	EAC	Accuracy (7 emotion)	65.32	—	Unverified
8	PAENet	Accuracy (7 emotion)	65.29	—	Unverified
9	DACL	Accuracy (7 emotion)	65.2	—	Unverified
10	DDAMFN++	Accuracy (8 emotion)	65.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ResEmoteNet	Overall Accuracy	94.76	—	Unverified
2	FMAE	Overall Accuracy	93.45	—	Unverified
3	QCS	Overall Accuracy	93.02	—	Unverified
4	Norface	Overall Accuracy	92.97	—	Unverified
5	S2D	Overall Accuracy	92.57	—	Unverified
6	BTN	Overall Accuracy	92.54	—	Unverified
7	GReFEL	Overall Accuracy	92.47	—	Unverified
8	DDAMFN++	Overall Accuracy	92.34	—	Unverified
9	DCJT	Overall Accuracy	92.24	—	Unverified
10	POSTER++	Overall Accuracy	92.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EfficientFER	Accuracy	82.47	—	Unverified
2	FERNeXt-SDAFE	Accuracy	81.33	—	Unverified
3	ResEmoteNet	Accuracy	79.79	—	Unverified
4	Ensemble ResMaskingNet with 6 other CNNs	Accuracy	76.82	—	Unverified
5	Mini-ResEmoteNet (A)	Accuracy	76.33	—	Unverified
6	EmoNeXt	Accuracy	76.12	—	Unverified
7	Segmentation VGG-19	Accuracy	75.97	—	Unverified
8	Local Learning Deep+BOW	Accuracy	75.42	—	Unverified
9	LHC-Net	Accuracy	74.42	—	Unverified
10	Residual Masking Network	Accuracy	74.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PAtt-Lite	Accuracy	95.55	—	Unverified
2	GReFEL	Accuracy	93.09	—	Unverified
3	QCS	Accuracy	91.85	—	Unverified
4	ResNet18 Dense Architecture	Accuracy	91.41	—	Unverified
5	DDAMFN	Accuracy	90.74	—	Unverified
6	KTN	Accuracy	90.49	—	Unverified
7	Vit-base + MAE	Accuracy	90.18	—	Unverified
8	FER-VT	Accuracy	90.04	—	Unverified
9	EAC	Accuracy	89.64	—	Unverified
10	LResNet50E-IR	Accuracy	89.26	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	Accuracy(on validation set)	65.5	—	Unverified
2	LResNet50E-IR (5 models with augmentation)	Accuracy(on validation set)	65.5	—	Unverified
3	EAC	Accuracy(on validation set)	65.32	—	Unverified
4	LResNet50E-IR (1 model with augmentation)	Accuracy(on validation set)	63.7	—	Unverified
5	LResNet50E-IR (1 model)	Accuracy(on validation set)	61.1	—	Unverified
6	Multi-task EfficientNet-B0	Accuracy(on validation set)	59.27	—	Unverified
7	resnet18_noisy	Accuracy(on validation set)	55.17	—	Unverified
8	resnet18	Accuracy(on validation set)	51.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoNeXt	Accuracy (8 emotion)	100	—	Unverified
2	PAtt-Lite	Accuracy (7 emotion)	100	—	Unverified
3	ViT + SE	Accuracy (7 emotion)	99.8	—	Unverified
4	FAN	Accuracy (7 emotion)	99.7	—	Unverified
5	Nonlinear eval on SL + SSL puzzling (B0)	Accuracy (7 emotion)	98.23	—	Unverified
6	DeepEmotion	Accuracy (7 emotion)	98	—	Unverified
7	FN2EN	Accuracy (8 emotion)	96.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KTN	Accuracy(pretrained)	90.49	—	Unverified
2	RAN (VGG-16)	Accuracy(pretrained)	89.16	—	Unverified
3	SENet Teacher	Accuracy(pretrained)	88.88	—	Unverified
4	Local Learning Deep + BOW	Accuracy(pretrained)	87.76	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TL	Accuracy	99.52	—	Unverified
2	GReFEL	Accuracy	96.67	—	Unverified
3	ViT	Accuracy	94.83	—	Unverified
4	DeepEmotion	Accuracy	92.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ada-DF	Accuracy	60.46	—	Unverified
2	RAN (VGG16+ResNet18)	Accuracy	56.4	—	Unverified
3	ViT + SE	Accuracy	54.29	—	Unverified
4	Island Loss	Accuracy	52.52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GReFEL	Accuracy	72.48	—	Unverified
2	EmoAffectNet LSTM	UAR	52.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Norface	ICC	0.74	—	Unverified
2	Ours (VGG-F)	ICC	0.72	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Norface	ICC	0.67	—	Unverified
2	Ours (VGG-F)	ICC	0.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeepEmotion	Accuracy	99.3	—	Unverified
2	GReFEL	Accuracy	98.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeXpression	Accuracy	98.63	—	Unverified
2	Facial Motion Prior Network	Accuracy	82.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic MTL	Accuracy (10-fold)	89.6	—	Unverified
2	PPDN	Accuracy (10-fold)	84.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Covariance Pooling	Accuracy	87	—	Unverified
2	Multi Label Output	Accuracy	79.26	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Covariance Pooling	Accuracy	58.14	—	Unverified
2	VGG-VD-16	Accuracy	54.82	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EfficientFace	Accuracy	85.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Sequential forward selection	Accuracy	88.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoAffectNet LSTM	UAR	79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ResEmoteNet	Accuracy	75.67	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ViT + SE	Accuracy	87.22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoAffectNet LSTM	UAR	69.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoAffectNet LSTM	UAR	82.8	—	Unverified