SOTAVerified

Program Synthesis

Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.

Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.

Papers

Showing 2130 of 423 papers

TitleStatusHype
Large Language Models for Code: Security Hardening and Adversarial TestingCode1
Code Building Genetic ProgrammingCode1
CLEVER: A Curated Benchmark for Formally Verified Code GenerationCode1
Constrained Decoding for Fill-in-the-Middle Code Language Models via Efficient Left and Right Quotienting of Context-Sensitive GrammarsCode1
CrossBeam: Learning to Search in Bottom-Up Program SynthesisCode1
A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human LevelCode1
PoE-World: Compositional World Modeling with Products of Programmatic ExpertsCode1
ANPL: Towards Natural Programming with Interactive DecompositionCode1
Analyzing the Effectiveness of Large Language Models on Text-to-SQL SynthesisCode1
CodeUpdateArena: Benchmarking Knowledge Editing on API UpdatesCode1
Show:102550
← PrevPage 3 of 43Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10038.5Unverified
2Multiclass localizerSuccess rate @budget 10034.2Unverified
#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10057Unverified
2Multiclass localizerSuccess rate @budget 10053.7Unverified
#ModelMetricClaimedVerifiedStatus
1CodeTrans-MT-TF-SmallAccuracy90.31Unverified