SOTAVerified

multimodal interaction

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 106 papers

TitleStatusHype
Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech ModelCode5
Segment and Track AnythingCode4
Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal InteractionCode4
I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-ExpertsCode2
OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with TransformerCode2
Foundations and Recent Trends in Multimodal Mobile Agents: A SurveyCode2
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person RetrievalCode2
Agent AI: Surveying the Horizons of Multimodal InteractionCode2
Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You WantCode2
LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context InferenceCode2
TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete DataCode2
Generative Multimodal Entity LinkingCode1
Narrative Action Evaluation with Prompt-Guided Multimodal InteractionCode1
Spider: Any-to-Many Multimodal LLMCode1
ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionCode1
UniMEL: A Unified Framework for Multimodal Entity Linking with Large Language ModelsCode1
A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party ConversationsCode1
Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer NetworksCode1
MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension TasksCode1
Multi-Grained Multimodal Interaction Network for Entity LinkingCode1
Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal TransformerCode1
CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion RecognitionCode1
Dynamic Modality Interaction Modeling for Image-Text RetrievalCode1
Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in ConversationsCode1
Cooperative Sentiment Agents for Multimodal Sentiment AnalysisCode1
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language ModelsCode1
LLMs Can Evolve Continually on Modality for X-Modal ReasoningCode1
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction ExpertsCode1
Temporal Pyramid Transformer with Multimodal Interaction for Video Question AnsweringCode1
Dialogue-based generation of self-driving simulation scenarios using Large Language ModelsCode1
Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness PredictionsCode0
Towards Explainable Multimodal Depression Recognition for Clinical InterviewsCode0
ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart UnderstandingCode0
Recurrent Multimodal Interaction for Referring Image SegmentationCode0
Multilevel Hierarchical Network with Multiscale Sampling for Video Question AnsweringCode0
MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal RetrievalCode0
Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational AgentsCode0
MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question AnsweringCode0
ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving VehicleCode0
Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory InstructionsCode0
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTCode0
DeepSORT-Driven Visual Tracking Approach for Gesture Recognition in Interactive Systems—0
A Review of Temporal Aspects of Hand Gesture Analysis Applied to Discourse Analysis and Natural Conversation—0
Dallah: A Dialect-Aware Multimodal Large Language Model for Arabic—0
A POMDP-based Multimodal Interaction System Using a Humanoid Robot—0
Corpus of Multimodal Interaction for Collaborative Planning—0
HGNET: A Hierarchical Feature Guided Network for Occupancy Flow Field Prediction—0
Computer Vision-Driven Gesture Recognition: Toward Natural and Intuitive Human-Computer—0
Guidelines for creating man-machine multimodal interfaces—0
Graph-based Fine-grained Multimodal Attention Mechanism for Sentiment Analysis—0
Show:102550
← PrevPage 1 of 3Next →

No leaderboard results yet.