SOTAVerified

Program Synthesis

Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.

Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.

Papers

Showing 2130 of 423 papers

TitleStatusHype
An Empirical Comparison of Cost Functions in Inductive Logic Programming0
Machine Learning meets Algebraic Combinatorics: A Suite of Datasets Capturing Research-level Conjecturing Ability in Pure Mathematics0
AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT ApplicationsCode1
Factorio Learning EnvironmentCode4
GPIoT: Tailoring Small Language Models for IoT Program Synthesis and DevelopmentCode1
Program Synthesis Dialog Agents for Interactive Decision-MakingCode0
Visual Agentic AI for Spatial Reasoning with a Dynamic API0
CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and DebuggingCode2
Proving the Coding Interview: A Benchmark for Formally Verified Code Generation0
Learning Semantics-aware Search Operators for Genetic Programming0
Show:102550
← PrevPage 3 of 43Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10038.5Unverified
2Multiclass localizerSuccess rate @budget 10034.2Unverified
#ModelMetricClaimedVerifiedStatus
1DrRepairSuccess rate @budget 10057Unverified
2Multiclass localizerSuccess rate @budget 10053.7Unverified
#ModelMetricClaimedVerifiedStatus
1CodeTrans-MT-TF-SmallAccuracy90.31Unverified