| Interpretability in Action: Exploratory Analysis of VPT, a Minecraft Agent | Jul 16, 2024 | Decision MakingMinecraft | —Unverified | 0 |
| IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents | Jul 12, 2024 | Minecraft | CodeCode Available | 1 |
| Craftium: An Extensible Framework for Creating Reinforcement Learning Environments | Jul 4, 2024 | BenchmarkingMinecraft | CodeCode Available | 2 |
| Collaborative Quest Completion with LLM-driven Non-Player Characters in Minecraft | Jul 3, 2024 | Minecraft | —Unverified | 0 |
| OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents | Jun 27, 2024 | DecoderImitation Learning | —Unverified | 0 |
| Nebula: A discourse aware Minecraft Builder | Jun 26, 2024 | Minecraft | —Unverified | 0 |
| Retrieval-Augmented Code Generation for Situated Action Generation: A Case Study on Minecraft | Jun 25, 2024 | Action GenerationCode Generation | —Unverified | 0 |
| STEVE Series: Step-by-Step Construction of Agent Systems in Minecraft | Jun 17, 2024 | Knowledge DistillationLanguage Modeling | —Unverified | 0 |
| 3D Building Generation in Minecraft via Large Language Models | Jun 13, 2024 | MinecraftSokoban | CodeCode Available | 0 |
| World Models with Hints of Large Language Models for Goal Achieving | Jun 11, 2024 | Decision MakingEfficient Exploration | —Unverified | 0 |
| VillagerAgent: A Graph-Based Multi-Agent Framework for Coordinating Complex Task Dependencies in Minecraft | Jun 9, 2024 | ManagementMinecraft | CodeCode Available | 2 |
| The Embodied World Model Based on LLM with Visual Information and Prediction-Oriented Prompts | Jun 2, 2024 | Minecraft | —Unverified | 0 |
| Crafting a Pogo Stick in Minecraft with Heuristic Search (Extended Abstract) | Jun 1, 2024 | Heuristic SearchMinecraft | CodeCode Available | 0 |
| LARM: Large Auto-Regressive Model for Long-Horizon Embodied Intelligence | May 27, 2024 | Decision MakingDescriptive | —Unverified | 0 |
| Extracting Heuristics from Large Language Models for Reward Shaping in Reinforcement Learning | May 24, 2024 | Language ModellingLarge Language Model | —Unverified | 0 |
| Luban: Building Open-Ended Creative Agents via Autonomous Embodied Verification | May 24, 2024 | Minecraft | —Unverified | 0 |
| DreamCraft: Text-Guided Generation of Functional 3D Environments in Minecraft | Apr 23, 2024 | Game DesignMinecraft | —Unverified | 0 |
| MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs | Mar 28, 2024 | AI AgentMinecraft | CodeCode Available | 2 |
| MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control | Mar 18, 2024 | Instruction FollowingMinecraft | CodeCode Available | 2 |
| Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation | Mar 13, 2024 | MinecraftNavigate | —Unverified | 0 |
| Your device may know you better than you know yourself -- continuous authentication on novel dataset using machine learning | Mar 6, 2024 | Minecraft | —Unverified | 0 |
| Playing NetHack with LLMs: Potential & Limitations as Zero-Shot Agents | Mar 1, 2024 | Decision MakingMinecraft | CodeCode Available | 1 |
| RL-GPT: Integrating Reinforcement Learning and Code-as-policy | Feb 29, 2024 | Minecraftreinforcement-learning | —Unverified | 0 |
| Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning | Feb 26, 2024 | GPUMinecraft | CodeCode Available | 3 |
| Large Language Models as Minecraft Agents | Feb 13, 2024 | Minecraft | —Unverified | 0 |
| Improving Agent Interactions in Virtual Environments with Language Models | Feb 8, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Minecraft-ify: Minecraft Style Image Generation with Text-guided Image Editing for In-Game Application | Feb 8, 2024 | Image GenerationMinecraft | —Unverified | 0 |
| S-Agents: Self-organizing Agents in Open-ended Environments | Feb 7, 2024 | Minecraft | CodeCode Available | 1 |
| Vision-Language Models Provide Promptable Representations for Reinforcement Learning | Feb 5, 2024 | Common Sense ReasoningInstruction Following | —Unverified | 0 |
| ReGAL: Refactoring Programs to Discover Generalizable Abstractions | Jan 29, 2024 | Date UnderstandingMath | CodeCode Available | 1 |
| Zero-shot Imitation Policy via Search in Demonstration Dataset | Jan 29, 2024 | Imitation LearningMinecraft | —Unverified | 0 |
| MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worlds | Dec 20, 2023 | Minecraft | CodeCode Available | 1 |
| MineObserver 2.0: A Deep Learning & In-Game Framework for Assessing Natural Language Descriptions of Minecraft Imagery | Dec 19, 2023 | Minecraft | —Unverified | 0 |
| Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft | Dec 14, 2023 | Minecraftreinforcement-learning | —Unverified | 0 |
| Learning adaptive planning representations with natural language guidance | Dec 13, 2023 | Decision MakingMinecraft | —Unverified | 0 |
| MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active Perception | Dec 12, 2023 | Minecraft | CodeCode Available | 0 |
| Creative Agents: Empowering Agents with Imagination for Creative Tasks | Dec 5, 2023 | Instruction FollowingLanguage Modelling | CodeCode Available | 1 |
| BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks | Dec 5, 2023 | BenchmarkingMinecraft | CodeCode Available | 1 |
| Visual Encoders for Data-Efficient Imitation Learning in Modern Video Games | Dec 4, 2023 | Atari GamesDecision Making | —Unverified | 0 |
| Meta-Diversity Search in Complex Systems, A Recipe for Artificial Open-Endedness ? | Dec 1, 2023 | DiversityMinecraft | —Unverified | 0 |
| See and Think: Embodied Agent in Virtual Environment | Nov 26, 2023 | MinecraftQuestion Answering | —Unverified | 0 |
| JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models | Nov 10, 2023 | Minecraft | —Unverified | 0 |
| Active Reasoning in an Open-World Environment | Nov 3, 2023 | Instruction FollowingMinecraft | —Unverified | 0 |
| Convolutional State Space Models for Long-Range Spatiotemporal Modeling | Oct 30, 2023 | MinecraftState Space Models | CodeCode Available | 1 |
| Probabilistic Modeling of Human Teams to Infer False Beliefs | Oct 19, 2023 | AI AgentMinecraft | —Unverified | 0 |
| Progressively Efficient Learning | Oct 13, 2023 | Decision MakingImitation Learning | —Unverified | 0 |
| LLaMA Rider: Spurring Large Language Models to Explore the Open World | Oct 13, 2023 | Decision MakingMinecraft | —Unverified | 0 |
| GROOT: Learning to Follow Instructions by Watching Gameplay Videos | Oct 12, 2023 | DecoderInstruction Following | —Unverified | 0 |
| Towards Evaluating Generalist Agents: An Automated Benchmark in Open World | Oct 12, 2023 | BenchmarkingDiversity | CodeCode Available | 1 |
| Octopus: Embodied Vision-Language Programmer from Environmental Feedback | Oct 12, 2023 | BenchmarkingCode Generation | CodeCode Available | 2 |