Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags Jun 16, 2024 Image to text Instruction Following
— Unverified 0DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding Jun 13, 2024 Instruction Following Language Modeling
— Unverified 0Comparison Visual Instruction Tuning Jun 13, 2024 Instruction Following Novelty Detection
— Unverified 0Mimicking User Data: On Mitigating Fine-Tuning Risks in Closed Large Language Models Jun 12, 2024 Instruction Following Safety Alignment
— Unverified 0FaceGPT: Self-supervised Learning to Chat about 3D Human Faces Jun 11, 2024 3D Face Reconstruction Face Model
— Unverified 0CoEvol: Constructing Better Responses for Instruction Finetuning through Multi-Agent Cooperation Jun 11, 2024 Instruction Following
Code Code Available 03D-Properties: Identifying Challenges in DPO and Charting a Path Forward Jun 11, 2024 Instruction Following Mathematical Problem-Solving
— Unverified 0OPTune: Efficient Online Preference Tuning Jun 11, 2024 Instruction Following
— Unverified 0Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning Jun 5, 2024 Attribute Domain Generalization
— Unverified 0Synthetic Programming Elicitation for Text-to-Code in Very Low-Resource Programming and Formal Languages Jun 5, 2024 Instruction Following Retrieval
Code Code Available 0Adversarial Moment-Matching Distillation of Large Language Models Jun 5, 2024 Imitation Learning Instruction Following
Code Code Available 0Scalable Ensembling For Mitigating Reward Overoptimisation Jun 3, 2024 Instruction Following Language Modeling
— Unverified 0LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models Jun 1, 2024 Fairness Instruction Following
— Unverified 0Phased Instruction Fine-Tuning for Large Language Models Jun 1, 2024 Instruction Following
Code Code Available 0clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents May 31, 2024 Instruction Following
— Unverified 0Improving Reward Models with Synthetic Critiques May 31, 2024 Instruction Following
— Unverified 0Joint Embeddings for Graph Instruction Tuning May 31, 2024 Instruction Following visual instruction following
— Unverified 0TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models May 30, 2024 Instruction Following
— Unverified 0Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory May 30, 2024 Instruction Following
— Unverified 0InstructionCP: A fast approach to transfer Large Language Models into target language May 30, 2024 Instruction Following
— Unverified 0SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulation May 30, 2024 Instruction Following parameter-efficient fine-tuning
— Unverified 0X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions May 30, 2024 Instruction Following Language Modeling
Code Code Available 0BLSP-KD: Bootstrapping Language-Speech Pre-training via Knowledge Distillation May 29, 2024 Instruction Following Knowledge Distillation
— Unverified 0X-VILA: Cross-Modality Alignment for Large Language Model May 29, 2024 Instruction Following Language Modeling
— Unverified 0Empowering Source-Free Domain Adaptation with MLLM-driven Curriculum Learning May 28, 2024 Domain Adaptation Instruction Following
Code Code Available 0Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation May 27, 2024 Instruction Following Language Modeling
— Unverified 0RE-Adapt: Reverse Engineered Adaptation of Large Language Models May 23, 2024 Instruction Following Retrieval
— Unverified 0From Role-Play to Drama-Interaction: An LLM Solution May 23, 2024 Instruction Following
— Unverified 0Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction May 22, 2024 Instruction Following
Code Code Available 0Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning May 22, 2024 Code Generation Instruction Following
— Unverified 0Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning May 16, 2024 Decision Making Instruction Following
— Unverified 0A safety realignment framework via subspace-oriented model fusion for large language models May 15, 2024 Instruction Following Math
Code Code Available 0SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models May 14, 2024 Adversarial Robustness Instruction Following
— Unverified 0SpeechVerse: A Large-scale Generalizable Audio Language Model May 14, 2024 Automatic Speech Recognition Benchmarking
— Unverified 0Improving Instruction Following in Language Models through Proxy-Based Uncertainty Estimation May 10, 2024 Instruction Following Language Modeling
Code Code Available 0Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation May 8, 2024 counterfactual Instruction Following
Code Code Available 0Long Context Alignment with Short Instructions and Synthesized Positions May 7, 2024 16k Instruction Following
— Unverified 0Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment May 6, 2024 Arithmetic Reasoning Code Generation
— Unverified 0LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model May 3, 2024 Image Captioning Instruction Following
Code Code Available 0WildChat: 1M ChatGPT Interaction Logs in the Wild May 2, 2024 Chatbot Instruction Following
— Unverified 0LLM-AD: Large Language Model based Audio Description System May 2, 2024 Instruction Following Language Modeling
— Unverified 0FLAME: Factuality-Aware Alignment for Large Language Models May 2, 2024 Hallucination Instruction Following
— Unverified 0Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation Apr 30, 2024 Caption Generation Hallucination
— Unverified 0HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models Apr 29, 2024 Instruction Following
— Unverified 0From Persona to Personalization: A Survey on Role-Playing Language Agents Apr 28, 2024 In-Context Learning Instruction Following
— Unverified 0URL: Universal Referential Knowledge Linking via Task-instructed Representation Compression Apr 24, 2024 Information Retrieval Instruction Following
Code Code Available 0Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models Apr 23, 2024 Instruction Following
— Unverified 0Socratic Planner: Self-QA-Based Zero-Shot Planning for Embodied Instruction Following Apr 21, 2024 In-Context Learning Instruction Following
— Unverified 0Look Before You Decide: Prompting Active Deduction of MLLMs for Assumptive Reasoning Apr 19, 2024 Benchmarking counterfactual
— Unverified 0Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V Apr 16, 2024 Instruction Following Multimodal Reasoning
— Unverified 0