Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning Jul 29, 2024 Chart Question Answering Question Answering
Code Code Available 2GOFA: A Generative One-For-All Model for Joint Graph Language Modeling Jul 12, 2024 All Language Modeling
Code Code Available 2BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Apr 17, 2021 Argument Retrieval Benchmarking
Code Code Available 2AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator Feb 15, 2024 Benchmarking Diagnostic
Code Code Available 2GMAI-VL & GMAI-VL-5.5M: A Large Vision-Language Model and A Comprehensive Multimodal Dataset Towards General Medical AI Nov 21, 2024 Decision Making Language Modeling
Code Code Available 2AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous Driving Dec 19, 2024 Autonomous Driving Benchmarking
Code Code Available 2GraphTranslator: Aligning Graph Model to Large Language Model for Open-ended Tasks Feb 11, 2024 Graph Question Answering Instruction Following
Code Code Available 2How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize Library Mar 31, 2024 Question Answering
Code Code Available 2BlendSQL: A Scalable Dialect for Unifying Hybrid Question Answering in Relational Algebra Feb 27, 2024 Question Answering
Code Code Available 2Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers Mar 22, 2024 Information Retrieval
Code Code Available 2BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questions Aug 19, 2023 MME Optical Character Recognition (OCR)
Code Code Available 2Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey Feb 27, 2024 Language Modeling Language Modelling
Code Code Available 2Knowledge Representation Learning: A Quantitative Review Dec 28, 2018 General Classification Information Retrieval
Code Code Available 2Learning to Filter Context for Retrieval-Augmented Generation Nov 14, 2023 Extractive Question-Answering Fact Verification
Code Code Available 2Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Sep 20, 2022 Multimodal Deep Learning Multimodal Reasoning
Code Code Available 2Learnware of Language Models: Specialized Small Language Models Can Do Big May 19, 2025 Privacy Preserving Question Answering
Code Code Available 2LongVLM: Efficient Long Video Understanding via Large Language Models Apr 4, 2024 Question Answering Video Question Answering
Code Code Available 2Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation May 22, 2024 Informativeness Language Modeling
Code Code Available 2LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning Nov 30, 2023 3D dense captioning Dense Captioning
Code Code Available 2Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering Apr 23, 2024 Graph Question Answering Hallucination
Code Code Available 2GeoChat: Grounded Large Vision-Language Model for Remote Sensing Nov 24, 2023 Instruction Following Language Modeling
Code Code Available 2GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities Jun 17, 2024 Audio Question Answering Instruction Following
Code Code Available 2From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks Jun 4, 2024 Image Captioning Language Modelling
Code Code Available 2Frozen Transformers in Language Models Are Effective Visual Encoder Layers Oct 19, 2023 Action Recognition Image-text Retrieval
Code Code Available 2GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question Answering Feb 4, 2024 Language Modeling Language Modelling
Code Code Available 2Efficient Large Multi-modal Models via Visual Context Compression Jun 28, 2024 Question Answering Visual Question Answering
Code Code Available 2FreeVA: Offline MLLM as Training-Free Video Assistant May 13, 2024 Fairness Question Answering
Code Code Available 2LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities May 22, 2023 Event Extraction graph construction
Code Code Available 2FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models Dec 30, 2024 Question Answering Token Reduction
Code Code Available 2Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMs Oct 14, 2024 Computational Efficiency Question Answering
Code Code Available 2F-LMM: Grounding Frozen Large Multimodal Models Jun 9, 2024 General Knowledge Instruction Following
Code Code Available 2LongForm: Effective Instruction Tuning with Reverse Instructions Apr 17, 2023 Long Form Question Answering News Generation
Code Code Available 2FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning Apr 1, 2025 Audio-visual Question Answering Audio-Visual Question Answering (AVQA)
Code Code Available 2From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models Oct 13, 2023 Hallucination Image Captioning
Code Code Available 2Lost in the Middle: How Language Models Use Long Contexts Jul 6, 2023 Language Modelling Position
Code Code Available 2LOVA3: Learning to Visual Question Answering, Asking and Assessment May 23, 2024 Question Answering Visual Question Answering
Code Code Available 2FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design Nov 23, 2023 Decision Making Language Modelling
Code Code Available 2LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models Jun 15, 2023 Hallucination Image Captioning
Code Code Available 2FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation Jun 10, 2025 Image-text Retrieval Question Answering
Code Code Available 2CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios Mar 7, 2024 Audio-visual Question Answering Audio-Visual Question Answering (AVQA)
Code Code Available 2Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering Nov 25, 2024 Question Answering Visual Question Answering
Code Code Available 2GIT: A Generative Image-to-text Transformer for Vision and Language May 27, 2022 Decoder Image Captioning
Code Code Available 2MC-LLaVA: Multi-Concept Personalized Vision-Language Model Nov 18, 2024 Language Modeling Language Modelling
Code Code Available 2MC-LLaVA: Multi-Concept Personalized Vision-Language Model Mar 24, 2025 Language Modeling Language Modelling
Code Code Available 2FinBERT-QA: Financial Question Answering with pre-trained BERT Language Models Apr 24, 2025 Answer Selection Information Retrieval
Code Code Available 2Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding Jan 9, 2024 Fact Verification In-Context Learning
Code Code Available 2Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis Mar 25, 2025 Contrastive Learning Image-text Retrieval
Code Code Available 2Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs Jun 13, 2024 Arithmetic Reasoning Fact Verification
Code Code Available 2A Survey on Benchmarks of Multimodal Large Language Models Aug 16, 2024 Question Answering Survey
Code Code Available 2Ask Me Anything: A simple strategy for prompting language models Oct 5, 2022 Coreference Resolution Natural Language Inference
Code Code Available 2