Multimodal Emotion Recognition

This is a leaderboard for multimodal emotion recognition on the IEMOCAP dataset. The modality abbreviations are A: Acoustic T: Text V: Visual

Please include the modality in the bracket after the model name.

All models must use standard five emotion categories and are evaluated in standard leave-one-session-out (LOSO). See the papers for references.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 61–70 of 180 papers

Title	Date	Tasks	Status	Hype
Joint Multimodal Transformer for Emotion Recognition in the Wild	Mar 15, 2024	Emotion RecognitionMultimodal Emotion Recognition	CodeCode Available	1
Curriculum Learning Meets Directed Acyclic Graph for Multimodal Emotion Recognition	Feb 27, 2024	Emotion RecognitionEmotion Recognition in Conversation	CodeCode Available	1
Multi-Modal Emotion Recognition by Text, Speech and Video Using Pretrained Transformers	Feb 11, 2024	DiversityEmotion Recognition	—Unverified	0
A Two-Stage Multimodal Emotion Recognition Model Based on Graph Contrastive Learning	Jan 3, 2024	ClassificationContrastive Learning	—Unverified	0
MART: Masked Affective RepresenTation Learning via Masked Temporal Distribution Distillation	Jan 1, 2024	Emotion RecognitionMultimodal Emotion Recognition	—Unverified	0
Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognition	Dec 28, 2023	Contrastive LearningEmotion Recognition	—Unverified	0
Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognition	Dec 26, 2023	Emotion RecognitionMultimodal Emotion Recognition	CodeCode Available	0
DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition	Dec 17, 2023	Contrastive LearningEmotion Recognition	—Unverified	0
Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations	Dec 11, 2023	Data AugmentationEmotion Recognition	—Unverified	0
GPT-4V with Emotion: A Zero-shot Benchmark for Generalized Emotion Recognition	Dec 7, 2023	Emotion RecognitionFacial Emotion Recognition	CodeCode Available	1

Show:10 25 50

← PrevPage 7 of 18Next →

All datasets IEMOCAP-4 MELD IEMOCAP CMU-MOSEI-Sentiment CMU-MOSEI-Sentiment-3 Expressive hands and faces dataset (EHF).MELD-Sentiment

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	86.52	—	Unverified
2	Joyful	Weighted F1	85.7	—	Unverified
3	COGMEN	Weighted F1	84.5	—	Unverified
4	DANN	Accuracy	82.7	—	Unverified
5	MMER	Accuracy	81.7	—	Unverified
6	PATHOSnet v2	Accuracy	80.4	—	Unverified
7	Self-attention weight correction (A+T)	Accuracy	76.8	—	Unverified
8	CHFusion	Accuracy	76.5	—	Unverified
9	bc-LSTM	Weighted F1	74.1	—	Unverified
10	Audio + Text (Stage III)	F1	70.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	66.71	—	Unverified
2	Audio + Text (Stage III)	Weighted F1	65.8	—	Unverified
3	Joyful	Weighted F1	61.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	72.81	—	Unverified
2	Joyful	Weighted F1	70.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	44.93	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	66.73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SMPLify-X	v2v error	52.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	74.31	—	Unverified