SOTAVerified

multimodal interaction

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 106 papers

TitleStatusHype
Stream-Omni: Simultaneous Multimodal Interactions with Large Language-Vision-Speech ModelCode5
Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal InteractionCode4
Segment and Track AnythingCode4
I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-ExpertsCode2
OVTR: End-to-End Open-Vocabulary Multiple Object Tracking with TransformerCode2
Foundations and Recent Trends in Multimodal Mobile Agents: A SurveyCode2
TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete DataCode2
LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context InferenceCode2
Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You WantCode2
Agent AI: Surveying the Horizons of Multimodal InteractionCode2
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person RetrievalCode2
Spider: Any-to-Many Multimodal LLMCode1
LLMs Can Evolve Continually on Modality for X-Modal ReasoningCode1
Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer NetworksCode1
Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in ConversationsCode1
UniMEL: A Unified Framework for Multimodal Entity Linking with Large Language ModelsCode1
Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language ModelsCode1
Narrative Action Evaluation with Prompt-Guided Multimodal InteractionCode1
Cooperative Sentiment Agents for Multimodal Sentiment AnalysisCode1
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction ExpertsCode1
Dialogue-based generation of self-driving simulation scenarios using Large Language ModelsCode1
MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension TasksCode1
CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion RecognitionCode1
Multi-Grained Multimodal Interaction Network for Entity LinkingCode1
A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party ConversationsCode1
Generative Multimodal Entity LinkingCode1
Temporal Pyramid Transformer with Multimodal Interaction for Video Question AnsweringCode1
Dynamic Modality Interaction Modeling for Image-Text RetrievalCode1
ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionCode1
Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal TransformerCode1
A multi-stage augmented multimodal interaction network for fish feeding intensity quantification—0
InterMT: Multi-Turn Interleaved Preference Alignment with Human Feedback—0
ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart UnderstandingCode0
DeepSORT-Driven Visual Tracking Approach for Gesture Recognition in Interactive Systems—0
A Survey of Interactive Generative Video—0
Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming—0
ReVision: A Dataset and Baseline VLM for Privacy-Preserving Task-Oriented Visual Instruction Rewriting—0
Interactive Sketchpad: A Multimodal Tutoring System for Collaborative, Visual Problem-Solving—0
Towards Explainable Multimodal Depression Recognition for Clinical InterviewsCode0
FGU3R: Fine-Grained Fusion via Unified 3D Representation for Multimodal 3D Object Detection—0
MODfinity: Unsupervised Domain Adaptation with Multimodal Information Flow Intertwining—0
Computer Vision-Driven Gesture Recognition: Toward Natural and Intuitive Human-Computer—0
CMATH: Cross-Modality Augmented Transformer with Hierarchical Variational Distillation for Multimodal Emotion Recognition in Conversation—0
Generative AI in Multimodal User Interfaces: Trends, Challenges, and Cross-Platform Adaptability—0
MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal RetrievalCode0
Phase Diagram of Vision Large Language Models Inference: A Perspective from Interaction across Image and Instruction—0
Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes—0
Retrospective Learning from Interactions—0
Robi Butler: Multimodal Remote Interaction with a Household Robot Assistant—0
LLM-Assisted Visual Analytics: Opportunities and Challenges—0
Show:102550
← PrevPage 1 of 3Next →

No leaderboard results yet.