SOTAVerified

Multimodal Emotion Recognition

This is a leaderboard for multimodal emotion recognition on the IEMOCAP dataset. The modality abbreviations are A: Acoustic T: Text V: Visual

Please include the modality in the bracket after the model name.

All models must use standard five emotion categories and are evaluated in standard leave-one-session-out (LOSO). See the papers for references.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–180 of 180 papers

TitleStatusHype
HCAM -- Hierarchical Cross Attention Model for Multi-modal Emotion Recognition—0
Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023—0
Inconsistency-Aware Cross-Attention for Audio-Visual Fusion in Dimensional Emotion Recognition—0
Interpretability for Multimodal Emotion Recognition using Concept Activation Vectors—0
Interpretable Multimodal Emotion Recognition using Facial Features and Physiological Signals—0
Investigating EEG-Based Functional Connectivity Patterns for Multimodal Emotion Recognition—0
Knowledge-aware Bayesian Co-attention for Multimodal Emotion Recognition—0
Leveraging Label Information for Multimodal Emotion Recognition—0
Leveraging Label Potential for Enhanced Multimodal Emotion Recognition—0
LLM supervised Pre-training for Multimodal Emotion Recognition in Conversations—0
LMR-CBT: Learning Modality-fused Representations with CB-Transformer for Multimodal Emotion Recognition from Unaligned Multimodal Sequences—0
M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues—0
MART: Masked Affective RepresenTation Learning via Masked Temporal Distribution Distillation—0
Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversation—0
MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition—0
MicroEmo: Time-Sensitive Multimodal Emotion Recognition with Micro-Expression Dynamics in Video Dialogues—0
Modality Influence in Multimodal Machine Learning—0
Multilevel Transformer For Multimodal Emotion Recognition—0
Multimodal Emotion-Cause Pair Extraction in Conversations—0
Multimodal Emotion Recognition among Couples from Lab Settings to Daily Life using Smartwatches—0
Multimodal Emotion Recognition and Sentiment Analysis in Multi-Party Conversation Contexts—0
Multimodal Emotion Recognition based on Facial Expressions, Speech, and EEG—0
Multimodal Emotion Recognition by Fusing Video Semantic in MOOC Learning Scenarios—0
Multi-Modal Emotion Recognition by Text, Speech and Video Using Pretrained Transformers—0
Multimodal Emotion Recognition for One-Minute-Gradual Emotion Challenge—0
Multimodal Affective States Recognition Based on Multiscale CNNs and Biologically Inspired Decision Fusion Model—0
MULTI-MODAL EMOTION RECOGNITION ON IEMOCAP WITH NEURAL NETWORKS.—0
Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning—0
Multimodal Emotion Recognition Using Multimodal Deep Learning—0
Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models—0
Show:102550
← PrevPage 4 of 4Next →
All datasetsIEMOCAP-4MELDIEMOCAPCMU-MOSEI-SentimentCMU-MOSEI-Sentiment-3Expressive hands and faces dataset (EHF).MELD-Sentiment

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F186.52—Unverified
2JoyfulWeighted F185.7—Unverified
3COGMENWeighted F184.5—Unverified
4DANNAccuracy82.7—Unverified
5MMERAccuracy81.7—Unverified
6PATHOSnet v2Accuracy80.4—Unverified
7Self-attention weight correction (A+T)Accuracy76.8—Unverified
8CHFusionAccuracy76.5—Unverified
9bc-LSTMWeighted F174.1—Unverified
10Audio + Text (Stage III)F170.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F166.71—Unverified
2Audio + Text (Stage III)Weighted F165.8—Unverified
3JoyfulWeighted F161.77—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F172.81—Unverified
2JoyfulWeighted F170.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F144.93—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F166.73—Unverified
#ModelMetricClaimedVerifiedStatus
1SMPLify-Xv2v error52.9—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F174.31—Unverified