| Translating a Visual LEGO Manual to a Machine-Executable Plan | Jul 25, 2022 | 3D Pose EstimationKeypoint Detection | —Unverified | 0 |
| Human-guided Collaborative Problem Solving: A Natural Language based Framework | Jul 19, 2022 | Minecraft | —Unverified | 0 |
| Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code | Jul 1, 2022 | Minecraft | CodeCode Available | 1 |
| Learning Controllable 3D Level Generators | Jun 27, 2022 | Minecraft | CodeCode Available | 1 |
| RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environments | Jun 24, 2022 | MinecraftTransfer Learning | CodeCode Available | 0 |
| Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos | Jun 23, 2022 | Imitation LearningMinecraft | CodeCode Available | 3 |
| NovelCraft: A Dataset for Novelty Detection and Discovery in Open Worlds | Jun 23, 2022 | MinecraftNovelty Detection | CodeCode Available | 0 |
| MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge | Jun 17, 2022 | Atari GamesMinecraft | CodeCode Available | 4 |
| Analysis of Dialogue in Human-Human Collaboration in Minecraft | Jun 1, 2022 | Minecraft | —Unverified | 0 |
| Learning to Execute Actions or Ask Clarification Questions | Apr 18, 2022 | Learning to ExecuteMinecraft | CodeCode Available | 1 |