| Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal Transformer | Jul 1, 2020 | multimodal interactionMulti-modal Named Entity Recognition | CodeCode Available | 1 | 5 |
| Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer Networks | Oct 7, 2024 | multimodal interaction | CodeCode Available | 1 | 5 |
| A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations | Jul 1, 2023 | Emotion RecognitionEmotion Recognition in Conversation | CodeCode Available | 1 | 5 |
| Dynamic Modality Interaction Modeling for Image-Text Retrieval | Jul 11, 2021 | cross-modal alignmentCross-Modal Retrieval | CodeCode Available | 1 | 5 |
| Dialogue-based generation of self-driving simulation scenarios using Large Language Models | Oct 26, 2023 | multimodal interactionSelf-Driving Cars | CodeCode Available | 1 | 5 |
| LLMs Can Evolve Continually on Modality for X-Modal Reasoning | Oct 26, 2024 | Continual Learningmultimodal interaction | CodeCode Available | 1 | 5 |
| Narrative Action Evaluation with Prompt-Guided Multimodal Interaction | Apr 22, 2024 | Action Quality Assessmentmultimodal interaction | CodeCode Available | 1 | 5 |
| Spider: Any-to-Many Multimodal LLM | Nov 14, 2024 | multimodal interaction | CodeCode Available | 1 | 5 |
| MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks | Oct 13, 2023 | multimodal interactionMultimodal Reasoning | CodeCode Available | 1 | 5 |
| ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision | Feb 5, 2021 | Cross-Modal RetrievalImage Retrieval | CodeCode Available | 1 | 5 |
