SOTAVerified

Program Synthesis

Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.

Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.

Papers

Showing 110 of 423 papers

TitleStatusHype
CoRE: Enhancing Metacognition with Label-free Self-evaluation in LRMs0
Structured Program Synthesis using LLMs: Results and Insights from the IPARC Challenge0
Matching Markets Meet LLMs: Algorithmic Reasoning with Ranked Preferences0
Chemical classification program synthesis using generative artificial intelligence0
Transductively Informed Inductive Program SynthesisCode0
CLEVER: A Curated Benchmark for Formally Verified Code GenerationCode1
PoE-World: Compositional World Modeling with Products of Programmatic ExpertsCode1
Enhancing Code Generation via Bidirectional Comment-Level Mutual GroundingCode0
Rewriting Pre-Training Data Boosts LLM Performance in Math and CodeCode1
QiMeng-Xpiler: Transcompiling Tensor Programs for Deep Learning Systems with a Neural-Symbolic Approach0
Show:102550
← PrevPage 1 of 43Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10038.5Unverified
2Multiclass localizerSuccess rate @budget 10034.2Unverified