SOTAVerified

Emotion Recognition

Emotion Recognition is an important area of research to enable effective human-computer interaction. Human emotions can be detected using speech signal, facial expressions, body language, and electroencephalography (EEG). Source: Using Deep Autoencoders for Facial Expression Recognition

Papers

Showing 150 of 2041 papers

TitleStatusHype
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMsCode11
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingCode11
R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement LearningCode5
Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction TuningCode4
Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCICode4
SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion RecognitionCode4
Addressing Emotion Bias in Music Emotion Recognition and Generation with Frechet Audio DistanceCode3
MER 2024: Semi-Supervised Learning, Noise Robustness, and Open-Vocabulary Multimodal Emotion RecognitionCode3
OSUM: Advancing Open Speech Understanding Models with Limited Resources in AcademiaCode3
SALMONN: Towards Generic Hearing Abilities for Large Language ModelsCode3
emotion2vec: Self-Supervised Pre-Training for Speech Emotion RepresentationCode3
EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and BenchmarkCode3
Personalized Large Language ModelsCode2
Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language ModelsCode2
BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 LanguagesCode2
Recent Trends of Multimodal Affective Computing: A Survey from NLP PerspectiveCode2
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion RecognitionCode2
SSAST: Self-Supervised Audio Spectrogram TransformerCode2
BLSP-Emo: Towards Empathetic Large Speech-Language ModelsCode2
MEEG and AT-DGNN: Improving EEG Emotion Recognition with Music Introducing and Graph-based LearningCode2
LibEER: A Comprehensive Benchmark and Algorithm Library for EEG-based Emotion RecognitionCode2
MER 2023: Multi-label Learning, Modality Robustness, and Semi-Supervised LearningCode2
Towards Interpretable Mental Health Analysis with Large Language ModelsCode2
PHemoNet: A Multimodal Network for Physiological SignalsCode2
HiCMAE: Hierarchical Contrastive Masked Autoencoder for Self-Supervised Audio-Visual Emotion RecognitionCode2
EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion RecognitionCode2
Feature Fusion Based on Mutual-Cross-Attention Mechanism for EEG Emotion RecognitionCode2
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion RecognitionCode2
Hierarchical Hypercomplex Network for Multimodal Emotion RecognitionCode2
EmoSphere-SER: Enhancing Speech Emotion Recognition Through Spherical Representation with Auxiliary ClassificationCode2
EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion AnalysisCode2
EMO-SUPERB: An In-depth Look at Speech Emotion RecognitionCode2
A Survey of Personalized Large Language Models: Progress and Future DirectionsCode2
CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AICode2
Dawn of the transformer era in speech emotion recognition: closing the valence gapCode2
EmoBench: Evaluating the Emotional Intelligence of Large Language ModelsCode2
audino: A Modern Annotation Tool for Audio and SpeechCode2
EMOCA: Emotion Driven Monocular Face Capture and AnimationCode2
COSMIC: COmmonSense knowledge for eMotion Identification in ConversationsCode2
Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding ChallengesCode2
Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile DevicesCode2
Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 TasksCode2
MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wildCode2
LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTCode2
CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in ConversationCode1
A Persian ASR-based SER: Modification of Sharif Emotional Speech Database and Investigation of Persian Text CorporaCode1
CoMPM: Context Modeling with Speaker’s Pre-trained Memory Tracking for Emotion Recognition in ConversationCode1
Beyond Silent Letters: Amplifying LLMs in Emotion Recognition with Vocal NuancesCode1
Accuracy enhancement method for speech emotion recognition from spectrogram using temporal frequency correlation and positional information learning through knowledge transferCode1
A proposal for Multimodal Emotion Recognition using aural transformers and Action Units on RAVDESS datasetCode1
Show:102550
← PrevPage 1 of 41Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1M2D-CLAPEmoA77.4Unverified
2M2D2EmoA76.7Unverified
3M2DEmoA76.1Unverified
4Jukebox (Pre-training: CALM)EmoA72.1Unverified
5CLMR (Pre-training: contrastive)EmoA67.8Unverified
#ModelMetricClaimedVerifiedStatus
1LogisticRegression on posteriors of xlsr-Wav2Vec2.0&bi-LSTM+AttentionAccuracy86.7Unverified
2MultiMAE-DERWAR83.61Unverified
3Intermediate-Attention-FusionAccuracy81.58Unverified
4Logistic Regression on posteriors of the CNN-14&biLSTM-GuidedSTAccuracy80.08Unverified
5ERANN-0-4Accuracy74.8Unverified
#ModelMetricClaimedVerifiedStatus
1CAGETop-3 Accuracy (%)14.73Unverified
2FocusCLIPTop-3 Accuracy (%)13.73Unverified
#ModelMetricClaimedVerifiedStatus
1VGG based5-class test accuracy66.13Unverified
#ModelMetricClaimedVerifiedStatus
1MaSaC-ERC-ZF1-score (Weighted)51.17Unverified
#ModelMetricClaimedVerifiedStatus
1BiHDMAccuracy40.34Unverified
#ModelMetricClaimedVerifiedStatus
1w2v2-L-robust-12Concordance correlation coefficient (CCC)0.64Unverified
#ModelMetricClaimedVerifiedStatus
14D-aNNAccuracy96.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN1'"1Unverified