SOTAVerified

Program Synthesis

Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.

Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 171–180 of 423 papers

TitleStatusHype
HumanEval on Latest GPT Models -- 2024Code0
LTL learning on GPUsCode0
WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment—0
SwissNYF: Tool Grounded LLM Agents for Black Box SettingCode0
Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases—0
Runtime phylogenetic analysis enables extreme subsampling for test-based problems—0
Learning logic programs by finding minimal unsatisfiable subprograms—0
DALex: Lexicase-like Selection via Diverse AggregationCode0
3D-PreMise: Can Large Language Models Generate 3D Shapes with Sharp Features and Parametric Control?—0
LLM4TDD: Best Practices for Test Driven Development Using Large Language Models—0
Show:102550
← PrevPage 18 of 43Next →
All datasetsSPoC TestPSPoC TestWAlgoLisp

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10038.5—Unverified
2Multiclass localizerSuccess rate @budget 10034.2—Unverified
#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10057—Unverified
2Multiclass localizerSuccess rate @budget 10053.7—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeTrans-MT-TF-SmallAccuracy90.31—Unverified