SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 10911100 of 1135 papers

TitleStatusHype
PanGEA: The Panoramic Graph Environment Annotation Toolkit0
A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environmentCode1
Are We There Yet? Learning to Localize in Embodied Instruction Following0
Factorizing Perception and Policy for Interactive Instruction FollowingCode1
Spatial Language Understanding for Object Search in Partially Observed City-scale EnvironmentsCode0
From “Before” to “After”: Generating Natural Language Instructions from Image Pairs in a Simple Visual Domain0
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction FollowingCode1
RMM: A Recursive Mental Model for Dialogue NavigationCode1
Modular Networks for Compositional Instruction Following0
Learning to Recombine and Resample Data for Compositional GeneralizationCode0
Show:102550
← PrevPage 110 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified