SOTAVerified

Multimodal Emotion Recognition

This is a leaderboard for multimodal emotion recognition on the IEMOCAP dataset. The modality abbreviations are A: Acoustic T: Text V: Visual

Please include the modality in the bracket after the model name.

All models must use standard five emotion categories and are evaluated in standard leave-one-session-out (LOSO). See the papers for references.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–175 of 180 papers

TitleStatusHype
HCAM -- Hierarchical Cross Attention Model for Multi-modal Emotion Recognition—0
Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023—0
Inconsistency-Aware Cross-Attention for Audio-Visual Fusion in Dimensional Emotion Recognition—0
Interpretability for Multimodal Emotion Recognition using Concept Activation Vectors—0
Interpretable Multimodal Emotion Recognition using Facial Features and Physiological Signals—0
Investigating EEG-Based Functional Connectivity Patterns for Multimodal Emotion Recognition—0
Knowledge-aware Bayesian Co-attention for Multimodal Emotion Recognition—0
Leveraging Label Information for Multimodal Emotion Recognition—0
Leveraging Label Potential for Enhanced Multimodal Emotion Recognition—0
LLM supervised Pre-training for Multimodal Emotion Recognition in Conversations—0
LMR-CBT: Learning Modality-fused Representations with CB-Transformer for Multimodal Emotion Recognition from Unaligned Multimodal Sequences—0
M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues—0
MART: Masked Affective RepresenTation Learning via Masked Temporal Distribution Distillation—0
Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversation—0
MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition—0
MicroEmo: Time-Sensitive Multimodal Emotion Recognition with Micro-Expression Dynamics in Video Dialogues—0
Modality Influence in Multimodal Machine Learning—0
Multilevel Transformer For Multimodal Emotion Recognition—0
Multimodal Emotion-Cause Pair Extraction in Conversations—0
Multimodal Emotion Recognition among Couples from Lab Settings to Daily Life using Smartwatches—0
Multimodal Emotion Recognition and Sentiment Analysis in Multi-Party Conversation Contexts—0
Multimodal Emotion Recognition based on Facial Expressions, Speech, and EEG—0
Multimodal Emotion Recognition by Fusing Video Semantic in MOOC Learning Scenarios—0
Multi-Modal Emotion Recognition by Text, Speech and Video Using Pretrained Transformers—0
Multimodal Emotion Recognition for One-Minute-Gradual Emotion Challenge—0
Show:102550
← PrevPage 7 of 8Next →
All datasetsIEMOCAP-4MELDIEMOCAPCMU-MOSEI-SentimentCMU-MOSEI-Sentiment-3Expressive hands and faces dataset (EHF).MELD-Sentiment

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F186.52—Unverified
2JoyfulWeighted F185.7—Unverified
3COGMENWeighted F184.5—Unverified
4DANNAccuracy82.7—Unverified
5MMERAccuracy81.7—Unverified
6PATHOSnet v2Accuracy80.4—Unverified
7Self-attention weight correction (A+T)Accuracy76.8—Unverified
8CHFusionAccuracy76.5—Unverified
9bc-LSTMWeighted F174.1—Unverified
10Audio + Text (Stage III)F170.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F166.71—Unverified
2Audio + Text (Stage III)Weighted F165.8—Unverified
3JoyfulWeighted F161.77—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F172.81—Unverified
2JoyfulWeighted F170.5—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F144.93—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F166.73—Unverified
#ModelMetricClaimedVerifiedStatus
1SMPLify-Xv2v error52.9—Unverified
#ModelMetricClaimedVerifiedStatus
1GraphSmileWeighted F174.31—Unverified