SOTAVerified

Automated Theorem Proving

The goal of Automated Theorem Proving is to automatically generate a proof, given a conjecture (the target theorem) and a knowledge base of known facts, all expressed in a formal language. Automated Theorem Proving is useful in a wide range of applications, including the verification and synthesis of software and hardware systems.

Source: Learning to Prove Theorems by Learning to Generate Theorems

Papers

Showing 151175 of 288 papers

TitleStatusHype
Semantic Parsing of Mathematics by Context-based Learning from Aligned Corpora and Theorem Proving0
Simple Dataset for Proof Method Recommendation in Isabelle/HOL (Dataset Description)0
Social Network Processes in the Isabelle and Coq Theorem Proving Communities0
TacticZero: Learning to Prove Theorems from Scratch with Deep Reinforcement Learning0
Task Success is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors0
TextGraphs-16 Natural Language Premise Selection Task: Zero-Shot Premise Selection with Prompting Generative Language Models0
The Horn Non-Clausal Class and its Polynomiality0
The Limits of AI Explainability: An Algorithmic Information Theory Approach0
The Mathematical Game0
Theorem Proving Based on Semantics of DNA Strand Graph0
The Role of Entropy in Guiding a Connection Prover0
Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers0
Towards Advanced Mathematical Reasoning for LLMs via First-Order Logic Theorem Proving0
Towards a Geometry Automated Provers Competition0
Towards Automated Functional Equation Proving: A Benchmark Dataset and A Domain-Specific In-Context Agent0
Towards Concise, Machine-discovered Proofs of Gödel's Two Incompleteness Theorems0
Towards Evolutionary Theorem Proving for Isabelle/HOL0
Towards Formal Fault Tree Analysis using Theorem Proving0
Towards Machine Learning Induction0
Towards Neural Theorem Proving at Scale0
Towards Scientific Discovery with Generative AI: Progress, Opportunities, and Challenges0
Towards United Reasoning for Automatic Induction in Isabelle/HOL0
Training a First-Order Theorem Prover from Synthetic Data0
Translating SUMO-K to Higher-Order Set Theory0
Vehicle: Interfacing Neural Network Verifiers with Interactive Theorem Provers0
Show:102550
← PrevPage 7 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Kimina-Prover-Previewcumulative80.74Unverified
2ProofAugcumulative66Unverified
3DeepSeek-Prover-V1.5cumulative63.5Unverified
4Subgoal-XLcumulative56.1Unverified
5DeepSeek-Provercumulative52Unverified
6Lyra + GPT-4cumulative47.1Unverified
7LEGO-Prover ChatGPTcumulative47.1Unverified
8Decomposing the Enigmacumulative45.5Unverified
9Evaristecumulative41Unverified
10Evariste-7dcumulative40.6Unverified
#ModelMetricClaimedVerifiedStatus
1EvaristePass@6458.6Unverified
2LEGO-Prover ChatGPTPass@10057Unverified
3Lyra + GPT-4Pass@10052Unverified
4Evariste-7dPass@6447.5Unverified
5GPT-fPass@6447.3Unverified
6Evariste-1dPass@6446.7Unverified
7DSP (62B Minerva informal)Pass@10043.9Unverified
8Lean GPT-fPass@829.3Unverified
9Lean tidyPass@116.8Unverified
10Metamath GPT-fPass@82Unverified
#ModelMetricClaimedVerifiedStatus
1MPNN-DagLSTMClassification Accuracy0.92Unverified
2FormulaNetClassification Accuracy0.9Unverified
3FormulaNet-basicClassification Accuracy0.89Unverified
4Siamese 1D CNN-LSTMClassification Accuracy0.83Unverified
5Siamese 1D CNNClassification Accuracy0.82Unverified
#ModelMetricClaimedVerifiedStatus
14-hop GNN, sub-expression sharingPercentage correct49.95Unverified
2Tactic Dependent LoopPercentage correct38.88Unverified
3BoW2 (extra -ves)Percentage correct36.55Unverified
4Deeper Wider WaveNetPercentage correct32.65Unverified
#ModelMetricClaimedVerifiedStatus
1FormulaNetClassification Accuracy0.9Unverified
2FormulaNet-basicClassification Accuracy0.89Unverified
31D CNNClassification Accuracy0.83Unverified
41D CNN-LSTMClassification Accuracy0.83Unverified
#ModelMetricClaimedVerifiedStatus
1EvaristePass@3272.4Unverified
2GPT-fPercentage correct56.2Unverified
3MetaGen-IL + HolophrasmPercentage correct22.1Unverified
4HolophrasmPercentage correct14.3Unverified
#ModelMetricClaimedVerifiedStatus
1Evariste-7dPass@6442.5Unverified
2Evariste-1dPass@6433.6Unverified
3EvaristePass@6432.1Unverified
4GPT-fPass@6430.6Unverified
#ModelMetricClaimedVerifiedStatus
1Proverbot9001Percentage correct19.36Unverified
2CoqGym/ASTacticPercentage correct4.99Unverified
#ModelMetricClaimedVerifiedStatus
1ASTacticPercentage correct12.2Unverified