Project proposal: A modular reinforcement learning based automated theorem prover

Code

• github.com/inpefess/basic-rl-prover
  OfficialIn papernone★ 1

Abstract

We propose to build a reinforcement learning prover of independent components: a deductive system (an environment), the proof state representation (how an agent sees the environment), and an agent training algorithm. To that purpose, we contribute an additional Vampire-based environment to gym-saturation package of OpenAI Gym environments for saturation provers. We demonstrate a prototype of using gym-saturation together with a popular reinforcement learning framework (Ray RLlib). Finally, we discuss our plans for completing this work in progress to a competitive automated theorem prover.

Tasks

Reproductions