Multimodal Emotion Recognition

This is a leaderboard for multimodal emotion recognition on the IEMOCAP dataset. The modality abbreviations are A: Acoustic T: Text V: Visual

Please include the modality in the bracket after the model name.

All models must use standard five emotion categories and are evaluated in standard leave-one-session-out (LOSO). See the papers for references.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 151–160 of 180 papers

Title	Date	Tasks	Status	Hype
Emotion Recognition in Audio and Video Using Deep Neural Networks	Jun 15, 2020	Deep LearningEmotion Recognition	CodeCode Available	1
Investigating EEG-Based Functional Connectivity Patterns for Multimodal Emotion Recognition	Apr 4, 2020	Brain Computer InterfaceClustering	—Unverified	0
EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege's Principle	Mar 14, 2020	Emotion RecognitionEmotion Recognition in Context	—Unverified	0
Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation	Feb 19, 2020	Emotion RecognitionEmotion Recognition in Conversation	CodeCode Available	1
Attentive Modality Hopping Mechanism for Speech Emotion Recognition	Nov 29, 2019	Emotion ClassificationEmotion Recognition	CodeCode Available	0
Multimodal Affective States Recognition Based on Multiscale CNNs and Biologically Inspired Decision Fusion Model	Nov 29, 2019	EEGElectroencephalogram (EEG)	—Unverified	0
M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues	Nov 9, 2019	Emotion RecognitionMultimodal Emotion Recognition	—Unverified	0
Multimodal Behavioral Markers Exploring Suicidal Intent in Social Media Videos	Oct 1, 2019	Multimodal Emotion RecognitionMultimodal Sentiment Analysis	CodeCode Available	0
Learning Alignment for Multimodal Emotion Recognition from Speech	Sep 6, 2019	Emotion RecognitionMultimodal Emotion Recognition	CodeCode Available	0
Towards Multimodal Emotion Recognition in German Speech Events in Cars using Transfer Learning	Sep 6, 2019	Emotion RecognitionMultimodal Emotion Recognition	—Unverified	0

Show:10 25 50

← PrevPage 16 of 18Next →

All datasets IEMOCAP-4 MELD IEMOCAP CMU-MOSEI-Sentiment CMU-MOSEI-Sentiment-3 Expressive hands and faces dataset (EHF).MELD-Sentiment

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	86.52	—	Unverified
2	Joyful	Weighted F1	85.7	—	Unverified
3	COGMEN	Weighted F1	84.5	—	Unverified
4	DANN	Accuracy	82.7	—	Unverified
5	MMER	Accuracy	81.7	—	Unverified
6	PATHOSnet v2	Accuracy	80.4	—	Unverified
7	Self-attention weight correction (A+T)	Accuracy	76.8	—	Unverified
8	CHFusion	Accuracy	76.5	—	Unverified
9	bc-LSTM	Weighted F1	74.1	—	Unverified
10	Audio + Text (Stage III)	F1	70.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	66.71	—	Unverified
2	Audio + Text (Stage III)	Weighted F1	65.8	—	Unverified
3	Joyful	Weighted F1	61.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	72.81	—	Unverified
2	Joyful	Weighted F1	70.5	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	44.93	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	66.73	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SMPLify-X	v2v error	52.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	GraphSmile	Weighted F1	74.31	—	Unverified