SOTAVerified

Multimodal Sentiment Analysis

Multimodal sentiment analysis is the task of performing sentiment analysis with multiple data sources - e.g. a camera feed of someone's face and their recorded speech.

( Image credit: ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 202 papers

TitleStatusHype
Exchanging-based Multimodal Fusion with TransformerCode1
MSAF: Multimodal Split Attention FusionCode1
Counterfactual Reasoning for Out-of-distribution Multimodal Sentiment AnalysisCode1
Towards Exploiting Sticker for Multimodal Sentiment Analysis in Social Media: A New Dataset and BaselineCode1
Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in ConversationCode1
Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma DistributionsCode1
Semi-IIN: Semi-supervised Intra-inter modal Interaction Learning Network for Multimodal Sentiment AnalysisCode1
Cooperative Sentiment Agents for Multimodal Sentiment AnalysisCode1
A Transformer-based joint-encoding for Emotion Recognition and Sentiment AnalysisCode1
SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment AnalysisCode1
Enhancing Multimodal Sentiment Analysis for Missing Modality through Self-Distillation and Unified Modality Cross-AttentionCode1
EmoVerse: Exploring Multimodal Large Language Models for Sentiment and Emotion UnderstandingCode1
Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal BehaviorsCode0
General Debiasing for Multimodal Sentiment AnalysisCode0
Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between ModalitiesCode0
Video-based Cross-modal Auxiliary Network for Multimodal Sentiment AnalysisCode0
Contextual Inter-modal Attention for Multi-modal Sentiment AnalysisCode0
Towards Arabic Multimodal Dataset for Sentiment AnalysisCode0
Context-Dependent Sentiment Analysis in User-Generated VideosCode0
The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor RecognitionCode0
Tensor Fusion Network for Multimodal Sentiment AnalysisCode0
Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal AlignmentCode0
Select-Additive Learning: Improving Generalization in Multimodal Sentiment AnalysisCode0
MemoSen: A Multimodal Dataset for Sentiment Analysis of MemesCode0
Integrating Multimodal Information in Large Pretrained TransformersCode0
On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment AnalysisCode0
CAtCh: Cognitive Assessment through Cookie ThiefCode0
Multimodal Speech Emotion Recognition Using Audio and TextCode0
LLaVAC: Fine-tuning LLaVA as a Multimodal Sentiment ClassifierCode0
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal FusionCode0
Multimodal Transformer for Unaligned Multimodal Language SequencesCode0
Multimodal Sentiment Analysis using Hierarchical Fusion with Context ModelingCode0
Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement LearningCode0
Sentiment-enhanced Graph-based Sarcasm Explanation in DialogueCode0
Multimodal Language Analysis with Recurrent Multistage FusionCode0
Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language modelsCode0
Multimodal Behavioral Markers Exploring Suicidal Intent in Social Media VideosCode0
Complementary Fusion of Multi-Features and Multi-Modalities in Sentiment AnalysisCode0
Hybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment AnalysisCode0
Multi-attention Recurrent Network for Human Communication ComprehensionCode0
GSIFN: A Graph-Structured and Interlaced-Masked Multimodal Transformer-based Fusion Network for Multimodal Sentiment AnalysisCode0
Graph Capsule Aggregation for Unaligned Multimodal SequencesCode0
Efficient Low-rank Multimodal Fusion with Modality-Specific FactorsCode0
Cross-Attention is Not Enough: Incongruity-Aware Dynamic Hierarchical Fusion for Multimodal Affect RecognitionCode0
Multimodal Sentiment Analysis To Explore the Structure of EmotionsCode0
Generalizable Multi-linear Attention Network—0
Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities—0
Gated Mechanism for Attention Based Multimodal Sentiment Analysis—0
CorMulT: A Semi-supervised Modality Correlation-aware Multimodal Transformer for Sentiment Analysis—0
Findings of the Shared Task on Multimodal Sentiment Analysis and Troll Meme Classification in Dravidian Languages—0
Show:102550
← PrevPage 2 of 5Next →

No leaderboard results yet.