| Agent AI: Surveying the Horizons of Multimodal Interaction | Jan 7, 2024 | multimodal interaction | CodeCode Available | 2 |
| MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts | Nov 16, 2023 | Binary ClassificationDescriptive | CodeCode Available | 1 |
| Dialogue-based generation of self-driving simulation scenarios using Large Language Models | Oct 26, 2023 | multimodal interactionSelf-Driving Cars | CodeCode Available | 1 |
| MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks | Oct 13, 2023 | multimodal interactionMultimodal Reasoning | CodeCode Available | 1 |
| Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition | Sep 20, 2023 | Gesture RecognitionHand Gesture Recognition | —Unverified | 0 |
| Adaptive User-centered Neuro-symbolic Learning for Multimodal Interaction with Autonomous Systems | Sep 11, 2023 | Incremental Learningmultimodal interaction | —Unverified | 0 |
| CFN-ESA: A Cross-Modal Fusion Network with Emotion-Shift Awareness for Dialogue Emotion Recognition | Jul 28, 2023 | Emotion RecognitionEmotion Recognition in Conversation | CodeCode Available | 1 |
| Multi-Grained Multimodal Interaction Network for Entity Linking | Jul 19, 2023 | Contrastive LearningDescriptive | CodeCode Available | 1 |
| A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations | Jul 1, 2023 | Emotion RecognitionEmotion Recognition in Conversation | CodeCode Available | 1 |
| Generative Multimodal Entity Linking | Jun 22, 2023 | Entity LinkingIn-Context Learning | CodeCode Available | 1 |
| Expanding the Role of Affective Phenomena in Multimodal Interaction Research | May 18, 2023 | multimodal interaction | —Unverified | 0 |
| Segment and Track Anything | May 11, 2023 | Autonomous Drivingmultimodal interaction | CodeCode Available | 4 |
| Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval | Mar 22, 2023 | Image-text matchingLanguage Modeling | CodeCode Available | 2 |
| A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT | Mar 7, 2023 | multimodal interaction | CodeCode Available | 0 |
| HTML: Hybrid Temporal-scale Multimodal Learning Framework for Referring Video Object Segmentation | Jan 1, 2023 | multimodal interactionObject | —Unverified | 0 |
| InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis | Dec 20, 2022 | Emotion Recognitionmultimodal interaction | —Unverified | 0 |
| A novel multimodal dynamic fusion network for disfluency detection in spoken utterances | Nov 27, 2022 | multimodal interaction | —Unverified | 0 |
| Adaptive User-Centered Multimodal Interaction towards Reliable and Trusted Automotive Interfaces | Nov 7, 2022 | multimodal interaction | —Unverified | 0 |
| Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Predictions | Nov 7, 2022 | Contrastive Learningmultimodal interaction | CodeCode Available | 0 |
| Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignment | Oct 10, 2022 | Articlesmultimodal interaction | —Unverified | 0 |
| MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning | Oct 9, 2022 | Image-text Retrievalmultimodal interaction | —Unverified | 0 |
| On the Horizon: Interactive and Compositional Deepfakes | Sep 5, 2022 | multimodal interaction | —Unverified | 0 |
| Chat-to-Design: AI Assisted Personalized Fashion Design | Jul 3, 2022 | multimodal interactionNatural Language Understanding | —Unverified | 0 |
| The VoxWorld Platform for Multimodal Embodied Agents | Jun 1, 2022 | multimodal interaction | —Unverified | 0 |
| RoomReader: A Multimodal Corpus of Online Multiparty Conversational Interactions | Jun 1, 2022 | multimodal interaction | —Unverified | 0 |
