Facial Motion Prior Networks for Facial Expression Recognition
Yuedong Chen, Jian-Feng Wang, Shikai Chen, Zhongchao shi, Jianfei Cai
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/donydchen/FMPN-FEROfficialIn paperpytorch★ 0
- github.com/WhiTExB3AR/Emotion_Diarypytorch★ 0
- github.com/WhiTExB3AR/PreProduceCode-FMPN-FERpytorch★ 0
- github.com/tarun-98/COMP8240_Project_GroupGpytorch★ 0
Abstract
Deep learning based facial expression recognition (FER) has received a lot of attention in the past few years. Most of the existing deep learning based FER methods do not consider domain knowledge well, which thereby fail to extract representative features. In this work, we propose a novel FER framework, named Facial Motion Prior Networks (FMPN). Particularly, we introduce an addition branch to generate a facial mask so as to focus on facial muscle moving regions. To guide the facial mask learning, we propose to incorporate prior domain knowledge by using the average differences between neutral faces and the corresponding expressive faces as the training guidance. Extensive experiments on three facial expression benchmark datasets demonstrate the effectiveness of the proposed method, compared with the state-of-the-art approaches.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| AffectNet | Facial Motion Prior Network | Accuracy (7 emotion) | 61.52 | — | Unverified |
| MMI | Facial Motion Prior Network | Accuracy | 82.74 | — | Unverified |