SOTAVerified

Automated Theorem Proving

The goal of Automated Theorem Proving is to automatically generate a proof, given a conjecture (the target theorem) and a knowledge base of known facts, all expressed in a formal language. Automated Theorem Proving is useful in a wide range of applications, including the verification and synthesis of software and hardware systems.

Source: Learning to Prove Theorems by Learning to Generate Theorems

Papers

Showing 176200 of 288 papers

TitleStatusHype
Verifier Theory and Unverifiability0
Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview0
0-1 laws for pattern occurrences in phylogenetic trees and networks0
Wu's Method can Boost Symbolic AI to Rival Silver Medalists and AlphaGeometry to Outperform Gold Medalists at IMO Geometry0
MPS-Prover: Advancing Stepwise Theorem Proving by Multi-Perspective Search and Data Curation0
3D-Prover: Diversity Driven Theorem Proving With Determinantal Point Processes0
A Categorization of Complexity Classes for Information Retrieval and Synthesis Using Natural Logic0
A Certified Proof Checker for Deep Neural Network Verification in Imandra0
A Combinatorial Identities Benchmark for Theorem Proving via Automated Theorem Generation0
Activation Steering in Neural Theorem Provers0
A Curious New Result of Resolution Strategies in Negation-Limited Inverters Problem0
Adversarial Learning to Reason in an Arbitrary Logic0
Analysis of Algorithms and Partial Algorithms0
An Experimental Study of Formula Embeddings for Automated Theorem Proving in First-Order Logic0
Anti-unification and Generalization: A Survey0
APE-Bench I: Towards File-level Automated Proof Engineering of Formal Math Libraries0
APOLLO: Automated LLM and Lean Collaboration for Advanced Formal Reasoning0
Applying Second-Order Quantifier Elimination in Inspecting Gödel's Ontological Proof0
Artifical intelligence and inherent mathematical difficulty0
Artificial Neural Networks that Learn to Satisfy Logic Constraints0
A state vector algebra for algorithmic implementation of second-order logic0
A Study of Continuous Vector Representationsfor Theorem Proving0
ATG: Benchmarking Automated Theorem Generation for Generative Language Models0
Autoformalization with Large Language Models0
Automated Planning Techniques for Elementary Proofs in Abstract Algebra0
Show:102550
← PrevPage 8 of 12Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Kimina-Prover-Previewcumulative80.74Unverified
2ProofAugcumulative66Unverified
3DeepSeek-Prover-V1.5cumulative63.5Unverified
4Subgoal-XLcumulative56.1Unverified
5DeepSeek-Provercumulative52Unverified
6Lyra + GPT-4cumulative47.1Unverified
7LEGO-Prover ChatGPTcumulative47.1Unverified
8Decomposing the Enigmacumulative45.5Unverified
9Evaristecumulative41Unverified
10Evariste-7dcumulative40.6Unverified
#ModelMetricClaimedVerifiedStatus
1EvaristePass@6458.6Unverified
2LEGO-Prover ChatGPTPass@10057Unverified
3Lyra + GPT-4Pass@10052Unverified
4Evariste-7dPass@6447.5Unverified
5GPT-fPass@6447.3Unverified
6Evariste-1dPass@6446.7Unverified
7DSP (62B Minerva informal)Pass@10043.9Unverified
8Lean GPT-fPass@829.3Unverified
9Lean tidyPass@116.8Unverified
10Metamath GPT-fPass@82Unverified
#ModelMetricClaimedVerifiedStatus
1MPNN-DagLSTMClassification Accuracy0.92Unverified
2FormulaNetClassification Accuracy0.9Unverified
3FormulaNet-basicClassification Accuracy0.89Unverified
4Siamese 1D CNN-LSTMClassification Accuracy0.83Unverified
5Siamese 1D CNNClassification Accuracy0.82Unverified
#ModelMetricClaimedVerifiedStatus
14-hop GNN, sub-expression sharingPercentage correct49.95Unverified
2Tactic Dependent LoopPercentage correct38.88Unverified
3BoW2 (extra -ves)Percentage correct36.55Unverified
4Deeper Wider WaveNetPercentage correct32.65Unverified
#ModelMetricClaimedVerifiedStatus
1FormulaNetClassification Accuracy0.9Unverified
2FormulaNet-basicClassification Accuracy0.89Unverified
31D CNNClassification Accuracy0.83Unverified
41D CNN-LSTMClassification Accuracy0.83Unverified
#ModelMetricClaimedVerifiedStatus
1EvaristePass@3272.4Unverified
2GPT-fPercentage correct56.2Unverified
3MetaGen-IL + HolophrasmPercentage correct22.1Unverified
4HolophrasmPercentage correct14.3Unverified
#ModelMetricClaimedVerifiedStatus
1Evariste-7dPass@6442.5Unverified
2Evariste-1dPass@6433.6Unverified
3EvaristePass@6432.1Unverified
4GPT-fPass@6430.6Unverified
#ModelMetricClaimedVerifiedStatus
1Proverbot9001Percentage correct19.36Unverified
2CoqGym/ASTacticPercentage correct4.99Unverified
#ModelMetricClaimedVerifiedStatus
1ASTacticPercentage correct12.2Unverified