SOTAVerified

Speech Emotion Recognition

Speech Emotion Recognition is a task of speech processing and computational paralinguistics that aims to recognize and categorize the emotions expressed in spoken language. The goal is to determine the emotional state of a speaker, such as happiness, anger, sadness, or frustration, from their speech patterns, such as prosody, pitch, and rhythm.

For multimodal emotion recognition, please upload your result to Multimodal Emotion Recognition on IEMOCAP

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 431 papers

TitleStatusHype
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingCode11
OSUM: Advancing Open Speech Understanding Models with Limited Resources in AcademiaCode3
Attention Is All You NeedCode3
EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and BenchmarkCode3
emotion2vec: Self-Supervised Pre-Training for Speech Emotion RepresentationCode3
EmoSphere-SER: Enhancing Speech Emotion Recognition Through Spherical Representation with Auxiliary ClassificationCode2
AST: Audio Spectrogram TransformerCode2
EMO-SUPERB: An In-depth Look at Speech Emotion RecognitionCode2
BLSP-Emo: Towards Empathetic Large Speech-Language ModelsCode2
Dawn of the transformer era in speech emotion recognition: closing the valence gapCode2
LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTCode2
SERAB: A multi-lingual benchmark for speech emotion recognitionCode1
SigWavNet: Learning Multiresolution Signal Wavelet Network for Speech Emotion RecognitionCode1
SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion RecognitionCode1
Seen and Unseen emotional style transfer for voice conversion with a new emotional speech datasetCode1
LSSED: a large-scale dataset and benchmark for speech emotion recognitionCode1
Semi-FedSER: Semi-supervised Learning for Speech Emotion Recognition On Federated Learning using Multiview Pseudo-LabelingCode1
SPEAKER VGG CCT: Cross-corpus Speech Emotion Recognition with Speaker Embedding and Vision TransformersCode1
Enhancing Speech Emotion Recognition Through Differentiable Architecture SearchCode1
Large Raw Emotional Dataset with Aggregation MechanismCode1
Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion RecognitionCode1
Jointly Fine-Tuning “BERT-like” Self Supervised Models to Improve Multimodal Speech Emotion RecognitionCode1
A Persian ASR-based SER: Modification of Sharif Emotional Speech Database and Investigation of Persian Text CorporaCode1
Odyssey 2024 - Speech Emotion Recognition Challenge: Dataset, Baseline Framework, and ResultsCode1
Pre-trained Deep Convolution Neural Network Model With Attention for Speech Emotion RecognitionCode1
Privacy-preserving Speech Emotion Recognition through Semi-Supervised Federated LearningCode1
SepTr: Separable Transformer for Audio Spectrogram ProcessingCode1
Deep Multilayer Perceptrons for Dimensional Speech Emotion RecognitionCode1
DWFormer: Dynamic Window transFormer for Speech Emotion RecognitionCode1
Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio DetectionCode1
Accuracy enhancement method for speech emotion recognition from spectrogram using temporal frequency correlation and positional information learning through knowledge transferCode1
Frame-level emotional state alignment method for speech emotion recognitionCode1
Emotion Recognition from Speech Using Wav2vec 2.0 EmbeddingsCode1
A vector quantized masked autoencoder for speech emotion recognitionCode1
Evaluation of Error and Correlation-Based Loss Functions For Multitask Learning Dimensional Speech Emotion RecognitionCode1
Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion RecognitionCode1
EmoGator: A New Open Source Vocal Burst Dataset with Baseline Machine Learning Classification MethodologiesCode1
Attribute Inference Attack of Speech Emotion Recognition in Federated Learning SettingsCode1
Efficient Speech Emotion Recognition Using Multi-Scale CNN and AttentionCode1
A proposal for Multimodal Emotion Recognition using aural transformers and Action Units on RAVDESS datasetCode1
Arabic Speech Emotion Recognition Employing Wav2vec2.0 and HuBERT Based on BAVED DatasetCode1
emoDARTS: Joint Optimisation of CNN & Sequential Neural Network Architectures for Superior Speech Emotion RecognitionCode1
EmoNet: A Transfer Learning Framework for Multi-Corpus Speech Emotion RecognitionCode1
GM-TCNet: Gated Multi-scale Temporal Convolutional Network using Emotion Causality for Speech Emotion RecognitionCode1
Continuous control with deep reinforcement learningCode1
Compact Graph Architecture for Speech Emotion RecognitionCode1
Exploring Wav2vec 2.0 fine-tuning for improved speech emotion recognitionCode1
Light-SERNet: A lightweight fully convolutional neural network for speech emotion recognitionCode1
MMER: Multimodal Multi-task Learning for Speech Emotion RecognitionCode1
Speech Emotion Diarization: Which Emotion Appears When?Code1
Show:102550
← PrevPage 1 of 9Next →
All datasetsCREMA-DIEMOCAPRAVDESSMSP-Podcast (Activation)MSP-Podcast (Dominance)MSP-Podcast (Valence)BERStRESDDusha CrowdDusha PodcastEMODBEmoDB Dataset

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Vertically long patch ViTAccuracy94.07—Unverified
2ConformerXL-PAccuracy88.2—Unverified
3CoordViTAccuracy82.96—Unverified
4SepTr + LeRaCAccuracy70.95—Unverified
5SepTrAccuracy70.47—Unverified
6ResNet-18 + SPELAccuracy68.12—Unverified
7ViTAccuracy67.81—Unverified
8ResNet-18 + PyNADAAccuracy65.15—Unverified
9GRUAccuracy55.01—Unverified
#ModelMetricClaimedVerifiedStatus
1SER with MTLUA CV0.78—Unverified
2emoDARTSUA CV0.77—Unverified
3LSTM+FCWA0.76—Unverified
4TAPWA CV0.74—Unverified
5SYSCOMB: BLSTMATT with CSA (session5)UA0.74—Unverified
6Partially Fine-tuned HuBERT LargeWA CV0.73—Unverified
7CNN - DARTSUA0.7—Unverified
8CNN+LSTMUA0.65—Unverified
#ModelMetricClaimedVerifiedStatus
1VQ-MAE-S-12 (Frame) + Query2EmoAccuracy84.1—Unverified
2CNN-X (Shallow CNN)Accuracy82.99—Unverified
3xlsr-Wav2Vec2.0(FineTuning)Accuracy81.82—Unverified
4CNN-14 (Fine-Tuning)Accuracy76.58—Unverified
5AlexNet (FineTuning)Accuracy61.67—Unverified
#ModelMetricClaimedVerifiedStatus
1wav2small-TeacherCCC0.76—Unverified
2wavlmCCC0.75—Unverified
3w2v2-L-robust-12CCC0.75—Unverified
4preCPCCCC0.71—Unverified
#ModelMetricClaimedVerifiedStatus
1wav2small-TeacherCCC0.68—Unverified
2wavlmCCC0.67—Unverified
3w2v2-L-robust-12CCC0.66—Unverified
4preCPCCCC0.64—Unverified
#ModelMetricClaimedVerifiedStatus
1wav2small-TeacherCCC0.68—Unverified
2wavlmCCC0.65—Unverified
3w2v2-L-robust-12CCC0.64—Unverified
4preCPCCCC0.38—Unverified
#ModelMetricClaimedVerifiedStatus
1DAWN-hidden-SVMUnweighted Accuracy (UA)32.1—Unverified
2Wav2Small-VAD-SVMUnweighted Accuracy (UA)23.3—Unverified
3Speechbrain Wav2Vec2Unweighted Accuracy (UA)20.7—Unverified
#ModelMetricClaimedVerifiedStatus
1emotion2vec+baseWeighted Accuracy (WA)79.4—Unverified
2emotion2vec+largeWeighted Accuracy (WA)69.5—Unverified
3emotion2vecWeighted Accuracy (WA)64.75—Unverified
#ModelMetricClaimedVerifiedStatus
1Dusha baselineMacro F10.77—Unverified
#ModelMetricClaimedVerifiedStatus
1Dusha baselineMacro F10.54—Unverified
#ModelMetricClaimedVerifiedStatus
1VGG-optiVMD1:1 Accuracy96.09—Unverified
#ModelMetricClaimedVerifiedStatus
1VQ-MAE-S-12 (Frame) + Query2EmoAccuracy90.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PyResNetUnweighted Accuracy (UA)0.43—Unverified
#ModelMetricClaimedVerifiedStatus
1emoDARTSUA0.66—Unverified
#ModelMetricClaimedVerifiedStatus
1LSTMCCC (Arousal)0.76—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN (1D)Unweighted Accuracy65.2—Unverified