SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 31–40 of 132 papers

TitleStatusHype
A Study of Vulnerability Repair in JavaScript Programs with Large Language Models—0
To Err is Machine: Vulnerability Detection Challenges LLM Reasoning—0
Enabling Automatic Repair of Source Code Vulnerabilities Using Data-Driven Methods—0
Agentic Bug Reproduction for Effective Automated Program Repair at Google—0
BigIssue: A Realistic Bug Localization Benchmark—0
RAP-Gen: Retrieval-Augmented Patch Generation with CodeT5 for Automatic Program Repair—0
ENCORE: Ensemble Learning using Convolution Neural Machine Translation for Automatic Program Repair—0
An LLM-as-Judge Metric for Bridging the Gap with Human Evaluation in SE Tasks—0
Automatic Programming: Large Language Models and Beyond—0
AdaptivePaste: Code Adaptation through Learning Semantics-aware Variable Usage Representations—0
Show:102550
← PrevPage 4 of 14Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5—Unverified
2TransformerAccuracy (%)62—Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6—Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678—Unverified