SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 426450 of 1135 papers

TitleStatusHype
Efficiently Enhancing Zero-Shot Performance of Instruction Following Model via Retrieval of Soft PromptCode1
Engineering flexible machine learning systems by traversing functionally-invariant pathsCode1
Inferring Rewards from Language in ContextCode1
Counterfactual Cycle-Consistent Learning for Instruction Following and Generation in Vision-Language NavigationCode1
Combining Modular Skills in Multitask LearningCode1
DialFRED: Dialogue-Enabled Agents for Embodied Instruction FollowingCode1
Guiding Multi-Step Rearrangement Tasks with Natural Language InstructionsCode1
FILM: Following Instructions in Language with Modular MethodsCode1
Waypoint Models for Instruction-guided Navigation in Continuous EnvironmentsCode1
Lexicon Learning for Few Shot Sequence ModelingCode1
Room-and-Object Aware Knowledge Reasoning for Remote Embodied Referring ExpressionCode1
Lexicon Learning for Few-Shot Neural Sequence ModelingCode1
A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environmentCode1
Factorizing Perception and Policy for Interactive Instruction FollowingCode1
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction FollowingCode1
RMM: A Recursive Mental Model for Dialogue NavigationCode1
AllenAct: A Framework for Embodied AI ResearchCode1
RMM: A Recursive Mental Model for Dialog NavigationCode1
Zero-Shot Compositional Policy Learning via Language GroundingCode1
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated FlightCode1
Following High-level Navigation Instructions on a Simulated Quadcopter with Imitation LearningCode1
AnyCap Project: A Unified Framework, Dataset, and Benchmark for Controllable Omni-modal Captioning0
How Many Instructions Can LLMs Follow at Once?0
Multilingual Multimodal Software Developer for Code Generation0
TuneShield: Mitigating Toxicity in Conversational AI while Fine-tuning on Untrusted Data0
Show:102550
← PrevPage 18 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified