| RGBT Tracking via All-layer Multimodal Interactions with Progressive Fusion Mamba | Aug 16, 2024 | AllMamba | —Unverified | 0 |
| Dissecting Dissonance: Benchmarking Large Multimodal Models Against Self-Contradictory Instructions | Aug 2, 2024 | Benchmarkingmultimodal interaction | CodeCode Available | 0 |
| A Unified Understanding of Adversarial Vulnerability Regarding Unimodal Models and Vision-Language Pre-training Models | Jul 25, 2024 | Data Augmentationmultimodal interaction | —Unverified | 0 |
| Dallah: A Dialect-Aware Multimodal Large Language Model for Arabic | Jul 25, 2024 | Image to textLanguage Modeling | —Unverified | 0 |
| Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents | Jul 1, 2024 | Emotional IntelligenceEmotion Classification | CodeCode Available | 0 |
| HGNET: A Hierarchical Feature Guided Network for Occupancy Flow Field Prediction | Jul 1, 2024 | Autonomous Drivingmultimodal interaction | —Unverified | 0 |
| A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE) | Jun 27, 2024 | AnatomyDeep Learning | —Unverified | 0 |
| OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents | Jun 27, 2024 | DecoderImitation Learning | —Unverified | 0 |
| EMMI -- Empathic Multimodal Motivational Interviews Dataset: Analyses and Annotations | Jun 24, 2024 | multimodal interaction | —Unverified | 0 |
| Revisiting Multimodal Emotion Recognition in Conversation from the Perspective of Graph Spectrum | Apr 27, 2024 | Contrastive LearningEmotion Recognition | —Unverified | 0 |
| BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI | Mar 20, 2024 | Image Generationmultimodal interaction | —Unverified | 0 |
| Improving Adversarial Transferability of Vision-Language Pre-training Models through Collaborative Multimodal Interaction | Mar 16, 2024 | Adversarial RobustnessImage-text Retrieval | —Unverified | 0 |
| On the Arrow of Inference | Feb 22, 2024 | counterfactualCounterfactual Reasoning | —Unverified | 0 |
| Memory-Inspired Temporal Prompt Interaction for Text-Image Classification | Jan 26, 2024 | Classificationimage-classification | —Unverified | 0 |
| Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition | Sep 20, 2023 | Gesture RecognitionHand Gesture Recognition | —Unverified | 0 |
| Adaptive User-centered Neuro-symbolic Learning for Multimodal Interaction with Autonomous Systems | Sep 11, 2023 | Incremental Learningmultimodal interaction | —Unverified | 0 |
| Expanding the Role of Affective Phenomena in Multimodal Interaction Research | May 18, 2023 | multimodal interaction | —Unverified | 0 |
| A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT | Mar 7, 2023 | multimodal interaction | CodeCode Available | 0 |
| HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation | Jan 1, 2023 | multimodal interactionObject | —Unverified | 0 |
| InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis | Dec 20, 2022 | Emotion Recognitionmultimodal interaction | —Unverified | 0 |
| A novel multimodal dynamic fusion network for disfluency detection in spoken utterances | Nov 27, 2022 | multimodal interaction | —Unverified | 0 |
| Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Predictions | Nov 7, 2022 | Contrastive Learningmultimodal interaction | CodeCode Available | 0 |
| Adaptive User-Centered Multimodal Interaction towards Reliable and Trusted Automotive Interfaces | Nov 7, 2022 | multimodal interaction | —Unverified | 0 |
| Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignment | Oct 10, 2022 | Articlesmultimodal interaction | —Unverified | 0 |
| MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning | Oct 9, 2022 | Image-text Retrievalmultimodal interaction | —Unverified | 0 |
| On the Horizon: Interactive and Compositional Deepfakes | Sep 5, 2022 | multimodal interaction | —Unverified | 0 |
| Chat-to-Design: AI Assisted Personalized Fashion Design | Jul 3, 2022 | multimodal interactionNatural Language Understanding | —Unverified | 0 |
| RoomReader: A Multimodal Corpus of Online Multiparty Conversational Interactions | Jun 1, 2022 | multimodal interaction | —Unverified | 0 |
| The VoxWorld Platform for Multimodal Embodied Agents | Jun 1, 2022 | multimodal interaction | —Unverified | 0 |
| Multilevel Hierarchical Network with Multiscale Sampling for Video Question Answering | May 9, 2022 | multimodal interactionQuestion Answering | CodeCode Available | 0 |
| Graph-based Fine-grained Multimodal Attention Mechanism for Sentiment Analysis | Nov 16, 2021 | multimodal interactionMultimodal Sentiment Analysis | —Unverified | 0 |
| ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle | Nov 3, 2021 | Emotion Recognitionmultimodal interaction | CodeCode Available | 0 |
| MIRTT: Learning Multimodal Interaction Representations from Trilinear Transformers for Visual Question Answering | Nov 1, 2021 | multimodal interactionMultiple-choice | CodeCode Available | 0 |
| Neural dSCA: demixing multimodal interaction among brain areas during naturalistic experiments | Jun 5, 2021 | Dimensionality ReductionExperimental Design | —Unverified | 0 |
| SocialInteractionGAN: Multi-person Interaction Sequence Generation | Mar 10, 2021 | Decodermultimodal interaction | —Unverified | 0 |
| Dyadic Speech-based Affect Recognition using DAMI-P2C Parent-child Multimodal Interaction Dataset | Aug 20, 2020 | multimodal interaction | —Unverified | 0 |
| SBAT: Video Captioning with Sparse Boundary-Aware Transformer | Jul 23, 2020 | Machine Translationmultimodal interaction | —Unverified | 0 |
| Dual Convolutional LSTM Network for Referring Image Segmentation | Jan 30, 2020 | DecoderImage Segmentation | —Unverified | 0 |
| Scene Graph based Image Retrieval -- A case study on the CLEVR Dataset | Nov 3, 2019 | Graph MatchingImage Retrieval | —Unverified | 0 |
| Corpus of Multimodal Interaction for Collaborative Planning | Jun 1, 2019 | multimodal interaction | —Unverified | 0 |
| HUMBO: Bridging Response Generation and Facial Expression Synthesis | May 24, 2019 | Dialogue Generationmultimodal interaction | —Unverified | 0 |
| Guidelines for creating man-machine multimodal interfaces | Jan 29, 2019 | multimodal interaction | —Unverified | 0 |
| Shaping a social robot's humor with Natural Language Generation and socially-aware reinforcement learning | Nov 1, 2018 | multimodal interactionreinforcement-learning | —Unverified | 0 |
| EmotiW 2018: Audio-Video, Student Engagement and Group-Level Affect Prediction | Aug 23, 2018 | Emotion Recognitionmultimodal interaction | —Unverified | 0 |
| Multimodal Interaction-aware Motion Prediction for Autonomous Street Crossing | Aug 21, 2018 | motion predictionmultimodal interaction | —Unverified | 0 |
| Toward Multimodal Interaction in Scalable Visual Digital Evidence Visualization Using Computer Vision Techniques and ISS | Aug 1, 2018 | Managementmultimodal interaction | —Unverified | 0 |
| An Evaluation Framework for Multimodal Interaction | May 1, 2018 | Gesture Recognitionmultimodal interaction | —Unverified | 0 |
| Automatized Generation of Alphabets of Symbols | Jul 16, 2017 | multimodal interaction | —Unverified | 0 |
| From Modal to Multimodal Ambiguities: a Classification Approach | Apr 4, 2017 | ClassificationGeneral Classification | —Unverified | 0 |
| Recurrent Multimodal Interaction for Referring Image Segmentation | Mar 23, 2017 | Image Segmentationmultimodal interaction | CodeCode Available | 0 |