SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 91–100 of 132 papers

TitleStatusHype
Using ML filters to help automated vulnerability repairs: when it helps and when it doesn't—0
Where's the Bug? Attention Probing for Scalable Fault Localization—0
Improving Automated Program Repair with Domain Adaptation—0
In-Context Code-Text Learning for Bimodal Software Engineering—0
Is ChatGPT the Ultimate Programming Assistant -- How far is it?—0
Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT—0
Learning to Fix Build Errors with Graph2Diff Neural Networks—0
LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks—0
Leveraging Causal Inference for Explainable Automatic Program Repair—0
Better patching using LLM prompting, via Self-Consistency—0
Show:102550
← PrevPage 10 of 14Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5—Unverified
2TransformerAccuracy (%)62—Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6—Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678—Unverified