SOTAVerified

Multimodal Sentiment Analysis

Multimodal sentiment analysis is the task of performing sentiment analysis with multiple data sources - e.g. a camera feed of someone's face and their recorded speech.

( Image credit: ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 202 papers

TitleStatusHype
Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature FusionCode1
MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language SequencesCode1
Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment AnalysisCode1
Cross-Modal BERT for Text-Audio Sentiment AnalysisCode1
Modulated Fusion using Transformer for Linguistic-Acoustic Emotion RecognitionCode1
Jointly Fine-Tuning “BERT-like” Self Supervised Models to Improve Multimodal Speech Emotion RecognitionCode1
CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of ModalityCode1
Multilogue-Net: A Context-Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in ConversationCode1
A Transformer-based joint-encoding for Emotion Recognition and Sentiment AnalysisCode1
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment AnalysisCode1
MuSe 2020 -- The First International Multimodal Sentiment Analysis in Real-life Media Challenge and WorkshopCode1
Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in ConversationCode1
CAtCh: Cognitive Assessment through Cookie ThiefCode0
An Empirical Study on Configuring In-Context Learning Demonstrations for Unleashing MLLMs' Sentimental Perception Capability—0
Multimodal Mixture of Low-Rank Experts for Sentiment Analysis and Emotion Recognition—0
Multimodal Sentiment Analysis on CMU-MOSEI Dataset using Transformer-based Models—0
Rethinking Multimodal Sentiment Analysis: A High-Accuracy, Simplified Fusion Architecture—0
Multimodal Transformers are Hierarchical Modal-wise Heterogeneous Graphs—0
Towards Explainable Fusion and Balanced Learning in Multimodal Sentiment Analysis—0
DeepMLF: Multimodal language model with learnable tokens for deep fusion in sentiment analysis—0
Hierarchical Adaptive Expert for Multimodal Sentiment Analysis—0
TI-JEPA: An Innovative Energy-based Joint Embedding Strategy for Text-Image Multimodal Systems—0
LLaVAC: Fine-tuning LLaVA as a Multimodal Sentiment ClassifierCode0
Dynamic Multimodal Sentiment Analysis: Leveraging Cross-Modal Attention for Enabled Classification—0
Modality-Invariant Bidirectional Temporal Representation Distillation Network for Missing Multimodal Sentiment Analysis—0
Seek Common Ground While Reserving Differences: Semi-Supervised Image-Text Sentiment Recognition—0
Enriching Multimodal Sentiment Analysis through Textual Emotional Descriptions of Visual-Audio Content—0
Multimodal Sentiment Analysis based on Video and Audio Inputs—0
Multimodal Sentiment Analysis Based on Causal Reasoning—0
Multimodal Sentiment Analysis Based on BERT and ResNet—0
Exploring Large Language Models for Multimodal Sentiment Analysis: Challenges, Benchmarks, and Future Directions—0
Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical Representation Learning—0
Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis—0
Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis—0
GSIFN: A Graph-Structured and Interlaced-Masked Multimodal Transformer-based Fusion Network for Multimodal Sentiment AnalysisCode0
CorMulT: A Semi-supervised Modality Correlation-aware Multimodal Transformer for Sentiment Analysis—0
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey—0
The MuSe 2024 Multimodal Sentiment Analysis Challenge: Social Perception and Humor RecognitionCode0
PTA: Enhancing Multimodal Sentiment Analysis through Pipelined Prediction and Translation-based Alignment—0
RNG: Reducing Multi-level Noise and Multi-grained Semantic Gap for Joint Multimodal Aspect-Sentiment Analysis—0
Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities—0
Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space—0
TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis—0
Towards Multimodal Sentiment Analysis Debiasing via Bias Purification—0
Emoji Driven Crypto Assets Market Reactions—0
Sentiment-enhanced Graph-based Sarcasm Explanation in DialogueCode0
Toward Robust Multimodal Learning using Multimodal Foundational Models—0
WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge—0
Contextual Augmented Global Contrast for Multimodal Intent Recognition—0
MART: Masked Affective RepresenTation Learning via Masked Temporal Distribution Distillation—0
Show:102550
← PrevPage 2 of 5Next →

No leaderboard results yet.