Speech Emotion Recognition

Speech Emotion Recognition is a task of speech processing and computational paralinguistics that aims to recognize and categorize the emotions expressed in spoken language. The goal is to determine the emotional state of a speaker, such as happiness, anger, sadness, or frustration, from their speech patterns, such as prosody, pitch, and rhythm.

For multimodal emotion recognition, please upload your result to Multimodal Emotion Recognition on IEMOCAP

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 76–100 of 431 papers

Title	Date	Tasks	Status	Hype
Conditioning LLMs with Emotion in Neural Machine Translation	Aug 6, 2024	Emotion RecognitionMachine Translation	—Unverified	0
Describe Where You Are: Improving Noise-Robustness for Speech Emotion Recognition with Text Description of the Environment	Jul 25, 2024	Emotion RecognitionLanguage Modeling	—Unverified	0
EMO-Codec: An In-Depth Look at Emotion Preservation capacity of Legacy and Neural Codec Models With Subjective and Objective Evaluations	Jul 22, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0
PCQ: Emotion Recognition in Speech via Progressive Channel Querying	Jul 17, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0
BSC-UPC at EmoSPeech-IberLEF2024: Attention Pooling for Emotion Recognition	Jul 17, 2024	Emotion RecognitionPosition	CodeCode Available	0
MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognition	Jul 8, 2024	AttributeEmotion Recognition	—Unverified	0
A Layer-Anchoring Strategy for Enhancing Cross-Lingual Speech Emotion Recognition	Jul 6, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0
Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition	Jul 1, 2024	Emotion RecognitionPrediction	CodeCode Available	0
Breaking Resource Barriers in Speech Emotion Recognition via Data Distillation	Jun 21, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0
Odyssey 2024 - Speech Emotion Recognition Challenge: Dataset, Baseline Framework, and Results	Jun 20, 2024	AttributeEmotion Recognition	CodeCode Available	1
Double Multi-Head Attention Multimodal System for Odyssey 2024 Speech Emotion Recognition Challenge	Jun 15, 2024	Emotion RecognitionPosition	—Unverified	0
Speech Emotion Recognition Using CNN and Its Use Case in Digital Healthcare	Jun 15, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0
What Does it Take to Generalize SER Model Across Datasets? A Comprehensive Benchmark	Jun 14, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0
Exploring Multilingual Unseen Speaker Emotion Recognition: Leveraging Co-Attention Cues in Multitask Learning	Jun 13, 2024	Emotion RecognitionSpeech Emotion Recognition	CodeCode Available	0
Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniques	Jun 12, 2024	Automatic Speech RecognitionAutomatic Speech Recognition (ASR)	CodeCode Available	0
Exploring Self-Supervised Multi-view Contrastive Learning for Speech Emotion Recognition with Limited Annotations	Jun 12, 2024	Contrastive LearningEmotion Recognition	—Unverified	0
ExHuBERT: Enhancing HuBERT Through Block Extension and Fine-Tuning on 37 Emotion Datasets	Jun 11, 2024	Emotion RecognitionSpeech Emotion Recognition	CodeCode Available	0
EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark	Jun 11, 2024	Cross-corpusEmotion Recognition	CodeCode Available	3
Enrolment-based personalisation for improving individual-level fairness in speech emotion recognition	Jun 10, 2024	Emotion RecognitionFairness	CodeCode Available	0
INTERSPEECH 2009 Emotion Challenge Revisited: Benchmarking 15 Years of Progress in Speech Emotion Recognition	Jun 10, 2024	BenchmarkingEmotion Recognition	CodeCode Available	0
Emo-bias: A Large Scale Evaluation of Social Bias on Speech Emotion Recognition	Jun 7, 2024	Emotion RecognitionSelf-Supervised Learning	—Unverified	0
BLSP-Emo: Towards Empathetic Large Speech-Language Models	Jun 6, 2024	Emotion RecognitionInstruction Following	CodeCode Available	2
Multi-Microphone Speech Emotion Recognition using the Hierarchical Token-semantic Audio Transformer Architecture	Jun 5, 2024	Emotion ClassificationEmotion Recognition	—Unverified	0
Unveiling Hidden Factors: Explainable AI for Feature Boosting in Speech Emotion Recognition	Jun 1, 2024	Emotion Recognitionfeature selection	CodeCode Available	0
1st Place Solution to Odyssey Emotion Recognition Challenge Task1: Tackling Class Imbalance Problem	May 30, 2024	Emotion RecognitionSpeech Emotion Recognition	—Unverified	0

Show:10 25 50

← PrevPage 4 of 18Next →

All datasets CREMA-D IEMOCAP RAVDESS MSP-Podcast (Activation)MSP-Podcast (Dominance)MSP-Podcast (Valence)BERSt RESD Dusha Crowd Dusha Podcast EMODB EmoDB Dataset

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	Vertically long patch ViT	Accuracy	94.07	—	Unverified
2	ConformerXL-P	Accuracy	88.2	—	Unverified
3	CoordViT	Accuracy	82.96	—	Unverified
4	SepTr + LeRaC	Accuracy	70.95	—	Unverified
5	SepTr	Accuracy	70.47	—	Unverified
6	ResNet-18 + SPEL	Accuracy	68.12	—	Unverified
7	ViT	Accuracy	67.81	—	Unverified
8	ResNet-18 + PyNADA	Accuracy	65.15	—	Unverified
9	GRU	Accuracy	55.01	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	SER with MTL	UA CV	0.78	—	Unverified
2	emoDARTS	UA CV	0.77	—	Unverified
3	LSTM+FC	WA	0.76	—	Unverified
4	TAP	WA CV	0.74	—	Unverified
5	SYSCOMB: BLSTMATT with CSA (session5)	UA	0.74	—	Unverified
6	Partially Fine-tuned HuBERT Large	WA CV	0.73	—	Unverified
7	CNN - DARTS	UA	0.7	—	Unverified
8	CNN+LSTM	UA	0.65	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	VQ-MAE-S-12 (Frame) + Query2Emo	Accuracy	84.1	—	Unverified
2	CNN-X (Shallow CNN)	Accuracy	82.99	—	Unverified
3	xlsr-Wav2Vec2.0(FineTuning)	Accuracy	81.82	—	Unverified
4	CNN-14 (Fine-Tuning)	Accuracy	76.58	—	Unverified
5	AlexNet (FineTuning)	Accuracy	61.67	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	wav2small-Teacher	CCC	0.76	—	Unverified
2	wavlm	CCC	0.75	—	Unverified
3	w2v2-L-robust-12	CCC	0.75	—	Unverified
4	preCPC	CCC	0.71	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	wav2small-Teacher	CCC	0.68	—	Unverified
2	wavlm	CCC	0.67	—	Unverified
3	w2v2-L-robust-12	CCC	0.66	—	Unverified
4	preCPC	CCC	0.64	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	wav2small-Teacher	CCC	0.68	—	Unverified
2	wavlm	CCC	0.65	—	Unverified
3	w2v2-L-robust-12	CCC	0.64	—	Unverified
4	preCPC	CCC	0.38	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	DAWN-hidden-SVM	Unweighted Accuracy (UA)	32.1	—	Unverified
2	Wav2Small-VAD-SVM	Unweighted Accuracy (UA)	23.3	—	Unverified
3	Speechbrain Wav2Vec2	Unweighted Accuracy (UA)	20.7	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	emotion2vec+base	Weighted Accuracy (WA)	79.4	—	Unverified
2	emotion2vec+large	Weighted Accuracy (WA)	69.5	—	Unverified
3	emotion2vec	Weighted Accuracy (WA)	64.75	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dusha baseline	Macro F1	0.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Dusha baseline	Macro F1	0.54	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	VGG-optiVMD	1:1 Accuracy	96.09	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	VQ-MAE-S-12 (Frame) + Query2Emo	Accuracy	90.2	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PyResNet	Unweighted Accuracy (UA)	0.43	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	emoDARTS	UA	0.66	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LSTM	CCC (Arousal)	0.76	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	CNN (1D)	Unweighted Accuracy	65.2	—	Unverified