Multimodal Emotion Recognition

This is a leaderboard for multimodal emotion recognition on the IEMOCAP dataset. The modality abbreviations are A: Acoustic T: Text V: Visual

Please include the modality in the bracket after the model name.

All models must use standard five emotion categories and are evaluated in standard leave-one-session-out (LOSO). See the papers for references.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 11–20 of 180 papers

Title	Date	Tasks	Status	Hype
Latent Distribution Decoupling: A Probabilistic Framework for Uncertainty-Aware Multimodal Emotion Recognition	Feb 19, 2025	Emotion RecognitionMultimodal Emotion Recognition	CodeCode Available	1
Milmer: a Framework for Multiple Instance Learning based Multimodal Emotion Recognition	Feb 1, 2025	EEGElectroencephalogram (EEG)	CodeCode Available	1
EmoVerse: Exploring Multimodal Large Language Models for Sentiment and Emotion Understanding	Dec 11, 2024	Depression DetectionEmotion-Cause Pair Extraction	CodeCode Available	1
SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for Incomplete Multimodal Learning in Conversational Emotion Recognition	Nov 29, 2024	Emotion RecognitionGraph Neural Network	CodeCode Available	1
Enhancing Modal Fusion by Alignment and Label Matching for Multimodal Emotion Recognition	Aug 18, 2024	Contrastive LearningEmotion Recognition	CodeCode Available	1
Tracing Intricate Cues in Dialogue: Joint Graph Structure and Sentiment Dynamics for Multimodal Emotion Recognition	Jul 31, 2024	Emotion RecognitionEmotion Recognition in Conversation	CodeCode Available	1
Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention	Jul 26, 2024	Emotion RecognitionMultimodal Emotion Recognition	CodeCode Available	1
MultiMAE-DER: Multimodal Masked Autoencoder for Dynamic Emotion Recognition	Apr 28, 2024	Emotion RecognitionMultimodal Emotion Recognition	CodeCode Available	1
Cooperative Sentiment Agents for Multimodal Sentiment Analysis	Apr 19, 2024	DisentanglementEmotion Recognition	CodeCode Available	1
MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Models	Mar 31, 2024	Emotion Cause ExtractionEmotion-Cause Pair Extraction	CodeCode Available	1

Show:10 25 50

← PrevPage 2 of 18Next →

All datasets IEMOCAP-4 MELD IEMOCAP CMU-MOSEI-Sentiment CMU-MOSEI-Sentiment-3 Expressive hands and faces dataset (EHF).MELD-Sentiment

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	86.52	—	Unverified
2	Joyful	Weighted F1	85.7	—	Unverified
3	COGMEN	Weighted F1	84.5	—	Unverified
4	DANN	Accuracy	82.7	—	Unverified
5	MMER	Accuracy	81.7	—	Unverified
6	PATHOSnet v2	Accuracy	80.4	—	Unverified
7	Self-attention weight correction (A+T)	Accuracy	76.8	—	Unverified
8	CHFusion	Accuracy	76.5	—	Unverified
9	bc-LSTM	Weighted F1	74.1	—	Unverified
10	Audio + Text (Stage III)	F1	70.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	66.71	—	Unverified
2	Audio + Text (Stage III)	Weighted F1	65.8	—	Unverified
3	Joyful	Weighted F1	61.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	72.81	—	Unverified
2	Joyful	Weighted F1	70.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	44.93	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	66.73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SMPLify-X	v2v error	52.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	74.31	—	Unverified