Facial Expression Recognition (FER)

Facial Expression Recognition (FER) is a computer vision task aimed at identifying and categorizing emotional expressions depicted on a human face. The goal is to automate the process of determining emotions in real-time, by analyzing the various features of a face such as eyebrows, eyes, mouth, and other features, and mapping them to a set of emotions such as anger, fear, surprise, sadness and happiness.

( Image credit: DeXpression )

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1–25 of 492 papers

Title	Date	Tasks	Status	Hype	Score
Detect Faces Efficiently: A Survey and Evaluations	Dec 3, 2021	Deep LearningFace Detection	CodeCode Available	3	5
Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devices	Mar 25, 2022	Arousal EstimationEmotion Recognition	CodeCode Available	2	5
MARLIN: Masked Autoencoder for facial video Representation LearnINg	Nov 12, 2022	Action ClassificationAttribute	CodeCode Available	2	5
FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space	May 3, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	2	5
Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfer	May 29, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	2	5
Representation Learning and Identity Adversarial Training for Facial Behavior Understanding	Jul 15, 2024	Facial Action Unit DetectionFacial Expression Recognition (FER)	CodeCode Available	2	5
Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition	Sep 15, 2021	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
Deep Facial Expression Recognition: A Survey	Apr 23, 2018	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
Efficient Facial Feature Learning with Wide Ensemble-based Convolutional Neural Networks	Jan 17, 2020	DiversityFacial Expression Recognition	CodeCode Available	1	5
Complete Face Recovery GAN: Unsupervised Joint Face Rotation and De-Occlusion From a Single-View Image	Jan 5, 2022	Face GenerationFacial Expression Recognition	CodeCode Available	1	5
AU-Expression Knowledge Constrained Representation Learning for Facial Expression Recognition	Dec 29, 2020	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
A novel facial emotion recognition model using segmentation VGG-19 architecture	Mar 24, 2023	Emotion RecognitionFacial Emotion Recognition	CodeCode Available	1	5
A Survey on Facial Expression Recognition of Static and Dynamic Emotions	Aug 28, 2024	cross-modal alignmentFacial Expression Recognition	CodeCode Available	1	5
Compacting, Picking and Growing for Unforgetting Continual Learning	Oct 15, 2019	Age And Gender ClassificationContinual Learning	CodeCode Available	1	5
Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations	Jul 10, 2021	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
A Dual-Direction Attention Mixed Feature Network for Facial Expression Recognition	Aug 25, 2023	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
A Dual-Branch Adaptive Distribution Fusion Framework for Real-World Facial Expression Recognition	May 5, 2023	Facial Expression Recognition (FER)	CodeCode Available	1	5
Challenges in Representation Learning: A report on three machine learning contests	Jul 1, 2013	BIG-bench Machine LearningFacial Expression Recognition	CodeCode Available	1	5
Cross-Domain Facial Expression Recognition: A Unified Evaluation Benchmark and Adversarial Graph Learning	Aug 3, 2020	Cross-Domain Facial Expression RecognitionDomain Adaptation	CodeCode Available	1	5
Adversarial Graph Representation Adaptation for Cross-Domain Facial Expression Recognition	Aug 3, 2020	Cross-Domain Facial Expression RecognitionFacial Expression Recognition	CodeCode Available	1	5
Ada-DF: An Adaptive Label Distribution Fusion Network For Facial Expression Recognition	Apr 24, 2024	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations	Jul 1, 2023	Emotion RecognitionEmotion Recognition in Conversation	CodeCode Available	1	5
Affect Expression Behaviour Analysis in the Wild using Spatio-Channel Attention and Complementary Context Information	Sep 29, 2020	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5
A novel deep learning approach for facial emotion recognition: application to detecting emotional responses in elderly individuals with Alzheimer’s disease	Dec 30, 2024	Emotion RecognitionFacial Emotion Recognition	CodeCode Available	1	5
BReG-NeXt: Facial Affect Computing Using Adaptive Residual Networks With Bounded Gradient	Apr 18, 2020	Facial Expression RecognitionFacial Expression Recognition (FER)	CodeCode Available	1	5

Show:10 25 50

← PrevPage 1 of 20Next →

All datasets AffectNet RAF-DB FER2013 FER+Acted Facial Expressions In The Wild (AFEW)CK+FERPlus JAFFE SFEW Aff-Wild2 BP4D DISFA

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResEmoteNet	Accuracy (7 emotion)	72.93	—	Unverified
2	Norface	Accuracy (8 emotion)	68.69	—	Unverified
3	EmoAffectNet	Accuracy (7 emotion)	66.49	—	Unverified
4	Emotion-GCN	Accuracy (7 emotion)	66.46	—	Unverified
5	FaceBehaviorNet	Accuracy (7 emotion)	65.4	—	Unverified
6	Ada-DF	Accuracy (7 emotion)	65.34	—	Unverified
7	EAC	Accuracy (7 emotion)	65.32	—	Unverified
8	PAENet	Accuracy (7 emotion)	65.29	—	Unverified
9	DACL	Accuracy (7 emotion)	65.2	—	Unverified
10	DDAMFN++	Accuracy (8 emotion)	65.04	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ResEmoteNet	Overall Accuracy	94.76	—	Unverified
2	FMAE	Overall Accuracy	93.45	—	Unverified
3	QCS	Overall Accuracy	93.02	—	Unverified
4	Norface	Overall Accuracy	92.97	—	Unverified
5	S2D	Overall Accuracy	92.57	—	Unverified
6	BTN	Overall Accuracy	92.54	—	Unverified
7	GReFEL	Overall Accuracy	92.47	—	Unverified
8	DDAMFN++	Overall Accuracy	92.34	—	Unverified
9	DCJT	Overall Accuracy	92.24	—	Unverified
10	POSTER++	Overall Accuracy	92.21	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EfficientFER	Accuracy	82.47	—	Unverified
2	FERNeXt-SDAFE	Accuracy	81.33	—	Unverified
3	ResEmoteNet	Accuracy	79.79	—	Unverified
4	Ensemble ResMaskingNet with 6 other CNNs	Accuracy	76.82	—	Unverified
5	Mini-ResEmoteNet (A)	Accuracy	76.33	—	Unverified
6	EmoNeXt	Accuracy	76.12	—	Unverified
7	Segmentation VGG-19	Accuracy	75.97	—	Unverified
8	Local Learning Deep+BOW	Accuracy	75.42	—	Unverified
9	LHC-Net	Accuracy	74.42	—	Unverified
10	Residual Masking Network	Accuracy	74.14	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PAtt-Lite	Accuracy	95.55	—	Unverified
2	GReFEL	Accuracy	93.09	—	Unverified
3	QCS	Accuracy	91.85	—	Unverified
4	ResNet18 Dense Architecture	Accuracy	91.41	—	Unverified
5	DDAMFN	Accuracy	90.74	—	Unverified
6	KTN	Accuracy	90.49	—	Unverified
7	Vit-base + MAE	Accuracy	90.18	—	Unverified
8	FER-VT	Accuracy	90.04	—	Unverified
9	EAC	Accuracy	89.64	—	Unverified
10	LResNet50E-IR	Accuracy	89.26	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	Accuracy(on validation set)	65.5	—	Unverified
2	LResNet50E-IR (5 models with augmentation)	Accuracy(on validation set)	65.5	—	Unverified
3	EAC	Accuracy(on validation set)	65.32	—	Unverified
4	LResNet50E-IR (1 model with augmentation)	Accuracy(on validation set)	63.7	—	Unverified
5	LResNet50E-IR (1 model)	Accuracy(on validation set)	61.1	—	Unverified
6	Multi-task EfficientNet-B0	Accuracy(on validation set)	59.27	—	Unverified
7	resnet18_noisy	Accuracy(on validation set)	55.17	—	Unverified
8	resnet18	Accuracy(on validation set)	51.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PAtt-Lite	Accuracy (7 emotion)	100	—	Unverified
2	EmoNeXt	Accuracy (8 emotion)	100	—	Unverified
3	ViT + SE	Accuracy (7 emotion)	99.8	—	Unverified
4	FAN	Accuracy (7 emotion)	99.7	—	Unverified
5	Nonlinear eval on SL + SSL puzzling (B0)	Accuracy (7 emotion)	98.23	—	Unverified
6	DeepEmotion	Accuracy (7 emotion)	98	—	Unverified
7	FN2EN	Accuracy (8 emotion)	96.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	KTN	Accuracy(pretrained)	90.49	—	Unverified
2	RAN (VGG-16)	Accuracy(pretrained)	89.16	—	Unverified
3	SENet Teacher	Accuracy(pretrained)	88.88	—	Unverified
4	Local Learning Deep + BOW	Accuracy(pretrained)	87.76	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TL	Accuracy	99.52	—	Unverified
2	GReFEL	Accuracy	96.67	—	Unverified
3	ViT	Accuracy	94.83	—	Unverified
4	DeepEmotion	Accuracy	92.8	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Ada-DF	Accuracy	60.46	—	Unverified
2	RAN (VGG16+ResNet18)	Accuracy	56.4	—	Unverified
3	ViT + SE	Accuracy	54.29	—	Unverified
4	Island Loss	Accuracy	52.52	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GReFEL	Accuracy	72.48	—	Unverified
2	EmoAffectNet LSTM	UAR	52.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Norface	ICC	0.74	—	Unverified
2	Ours (VGG-F)	ICC	0.72	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Norface	ICC	0.67	—	Unverified
2	Ours (VGG-F)	ICC	0.6	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeepEmotion	Accuracy	99.3	—	Unverified
2	GReFEL	Accuracy	98.18	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DeXpression	Accuracy	98.63	—	Unverified
2	Facial Motion Prior Network	Accuracy	82.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dynamic MTL	Accuracy (10-fold)	89.6	—	Unverified
2	PPDN	Accuracy (10-fold)	84.59	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Covariance Pooling	Accuracy	87	—	Unverified
2	Multi Label Output	Accuracy	79.26	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Covariance Pooling	Accuracy	58.14	—	Unverified
2	VGG-VD-16	Accuracy	54.82	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EfficientFace	Accuracy	85.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Sequential forward selection	Accuracy	88.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoAffectNet LSTM	UAR	79	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ResEmoteNet	Accuracy	75.67	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	ViT + SE	Accuracy	87.22	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoAffectNet LSTM	UAR	69.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	EmoAffectNet LSTM	UAR	82.8	—	Unverified