SOTAVerified

Program Synthesis

Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.

Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 423 papers

TitleStatusHype
COOL: Efficient and Reliable Chain-Oriented Objective Logic with Neural Networks Feedback Control for Program Synthesis—0
Mechanic Maker: Accessible Game Development Via Symbolic Learning Program Synthesis—0
MathDSL: A Domain-Specific Language for Concise Mathematical Solutions Via Program SynthesisCode0
Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning—0
Combining LLM Code Generation with Formal Specifications and Reactive Program Synthesis—0
AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz TestingCode1
Adaptive Language-Guided Abstraction from Contrastive Explanations—0
H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus BenchmarkCode1
Statically Contextualizing Large Language Models with Typed Holes—0
Procedural Synthesis of Synthesizable MoleculesCode1
Relational decomposition for program synthesisCode0
Can Large Language Models Understand Symbolic Graphics Programs?—0
h4rm3l: A language for Composable Jailbreak Attack Synthesis—0
A Neurosymbolic Approach to Adaptive Feature Extraction in SLAM—0
VRDSynth: Synthesizing Programs for Multilingual Visually Rich Document Information Extraction—0
CodeUpdateArena: Benchmarking Knowledge Editing on API UpdatesCode1
Effective Adaptive Mutation Rates for Program Synthesis—0
Bug In the Code Stack: Can LLMs Find Bugs in Large Python Code StacksCode1
FVEL: Interactive Formal Verification Environment with Large Language Models via Theorem ProvingCode0
Program Synthesis Benchmark for Visual Programming in XLogoOnline Environment—0
Learning Language Structures through Grounding—0
Guiding LLM Temporal Logic Generation with Explicit Separation of Data and Control—0
How Efficient is LLM-Generated Code? A Rigorous & High-Standard BenchmarkCode1
Amortizing Pragmatic Program Synthesis with Rankings—0
Diffusion On Syntax Trees For Program Synthesis—0
Show:102550
← PrevPage 3 of 17Next →
All datasetsSPoC TestPSPoC TestWAlgoLisp

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10038.5—Unverified
2Multiclass localizerSuccess rate @budget 10034.2—Unverified
#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10057—Unverified
2Multiclass localizerSuccess rate @budget 10053.7—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeTrans-MT-TF-SmallAccuracy90.31—Unverified