SOTAVerified

Instruction Following

Instruction following is the basic task of the model. This task is dedicated to evaluating the ability of the large model to follow human instructions. It is hoped that the model can generate controllable and safe answers.

Papers

Showing 431440 of 1135 papers

TitleStatusHype
DialFRED: Dialogue-Enabled Agents for Embodied Instruction FollowingCode1
Guiding Multi-Step Rearrangement Tasks with Natural Language InstructionsCode1
FILM: Following Instructions in Language with Modular MethodsCode1
Waypoint Models for Instruction-guided Navigation in Continuous EnvironmentsCode1
Lexicon Learning for Few Shot Sequence ModelingCode1
Room-and-Object Aware Knowledge Reasoning for Remote Embodied Referring ExpressionCode1
Lexicon Learning for Few-Shot Neural Sequence ModelingCode1
A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environmentCode1
Factorizing Perception and Policy for Interactive Instruction FollowingCode1
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction FollowingCode1
Show:102550
← PrevPage 44 of 114Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AutoIF (Llama3 70B)Inst-level loose-accuracy90.4Unverified
2AutoIF (Qwen2 72B)Inst-level loose-accuracy88Unverified
3GPT-4Inst-level loose-accuracy85.37Unverified
4PaLM 2 SInst-level loose-accuracy59.11Unverified