Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach Jun 5, 2024 Image Retrieval Instruction Following
Code Code Available 1Adversarial Moment-Matching Distillation of Large Language Models Jun 5, 2024 Imitation Learning Instruction Following
Code Code Available 0Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning Jun 5, 2024 Attribute Domain Generalization
— Unverified 0Scalable Ensembling For Mitigating Reward Overoptimisation Jun 3, 2024 Instruction Following Language Modeling
— Unverified 0LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models Jun 1, 2024 Fairness Instruction Following
— Unverified 0Phased Instruction Fine-Tuning for Large Language Models Jun 1, 2024 Instruction Following
Code Code Available 0clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents May 31, 2024 Instruction Following
— Unverified 0Improving Reward Models with Synthetic Critiques May 31, 2024 Instruction Following
— Unverified 0Joint Embeddings for Graph Instruction Tuning May 31, 2024 Instruction Following visual instruction following
— Unverified 0SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation May 30, 2024 Instruction Following parameter-efficient fine-tuning
— Unverified 0TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models May 30, 2024 Instruction Following
— Unverified 0X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions May 30, 2024 Instruction Following Language Modeling
Code Code Available 0Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory May 30, 2024 Instruction Following
— Unverified 0Instruction-Guided Visual Masking May 30, 2024 Instruction Following Visual Grounding
Code Code Available 1Is In-Context Learning Sufficient for Instruction Following in LLMs? May 30, 2024 In-Context Learning Instruction Following
Code Code Available 1InstructionCP: A fast approach to transfer Large Language Models into target language May 30, 2024 Instruction Following
— Unverified 0AlchemistCoder: Harmonizing and Eliciting Code Capability by Hindsight Tuning on Multi-source Data May 29, 2024 Code Generation Diversity
Code Code Available 1X-VILA: Cross-Modality Alignment for Large Language Model May 29, 2024 Instruction Following Language Modeling
— Unverified 0MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn Interactions May 29, 2024 Benchmarking Dialogue Understanding
Code Code Available 1BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation May 29, 2024 Instruction Following Knowledge Distillation
— Unverified 0Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models May 29, 2024 Instruction Following Language Modeling
Code Code Available 2Self-Exploring Language Models: Active Preference Elicitation for Online Alignment May 29, 2024 Instruction Following
Code Code Available 2Empowering Source-Free Domain Adaptation with MLLM-driven Curriculum Learning May 28, 2024 Domain Adaptation Instruction Following
Code Code Available 0Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation May 27, 2024 Instruction Following Language Modeling
— Unverified 0PromptFix: You Prompt and We Fix the Photo May 27, 2024 Denoising Image Generation
Code Code Available 4RE-Adapt: Reverse Engineered Adaptation of Large Language Models May 23, 2024 Instruction Following Retrieval
— Unverified 0From Role-Play to Drama-Interaction: An LLM Solution May 23, 2024 Instruction Following
— Unverified 0EditWorld: Simulating World Dynamics for Instruction-Following Image Editing May 23, 2024 Instruction Following
Code Code Available 2SimPO: Simple Preference Optimization with a Reference-Free Reward May 23, 2024 Chatbot Instruction Following
Code Code Available 4A Survey on Vision-Language-Action Models for Embodied AI May 23, 2024 Image Captioning Instruction Following
Code Code Available 4Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning May 22, 2024 Code Generation Instruction Following
— Unverified 0Mosaic-IT: Free Compositional Data Augmentation Improves Instruction Tuning May 22, 2024 Data Augmentation Diversity
Code Code Available 1Vikhr: Constructing a State-of-the-art Bilingual Open-Source Instruction-Following Large Language Model for Russian May 22, 2024 Instruction Following Language Modeling
Code Code Available 2Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction May 22, 2024 Instruction Following
Code Code Available 0RecGPT: Generative Pre-training for Text-based Recommendation May 21, 2024 Instruction Following Language Modeling
Code Code Available 1Grounded 3D-LLM with Referent Tokens May 16, 2024 Dense Captioning Diversity
Code Code Available 2Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning May 16, 2024 Decision Making Instruction Following
— Unverified 0A safety realignment framework via subspace-oriented model fusion for large language models May 15, 2024 Instruction Following Math
Code Code Available 0SpeechVerse: A Large-scale Generalizable Audio Language Model May 14, 2024 Automatic Speech Recognition Benchmarking
— Unverified 0SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models May 14, 2024 Adversarial Robustness Instruction Following
— Unverified 0Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation May 10, 2024 Instruction Following Language Modeling
Code Code Available 0CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts May 9, 2024 Image Captioning Instruction Following
Code Code Available 2Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation May 8, 2024 counterfactual Instruction Following
Code Code Available 0Long Context Alignment with Short Instructions and Synthesized Positions May 7, 2024 16k Instruction Following
— Unverified 0Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment May 6, 2024 Arithmetic Reasoning Code Generation
— Unverified 0LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model May 3, 2024 Image Captioning Instruction Following
Code Code Available 0WildChat: 1M ChatGPT Interaction Logs in the Wild May 2, 2024 Chatbot Instruction Following
— Unverified 0LLM-AD: Large Language Model based Audio Description System May 2, 2024 Instruction Following Language Modeling
— Unverified 0FLAME: Factuality-Aware Alignment for Large Language Models May 2, 2024 Hallucination Instruction Following
— Unverified 0Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation Apr 30, 2024 Caption Generation Hallucination
— Unverified 0