SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 21–30 of 132 papers

TitleStatusHype
KNOD: Domain Knowledge Distilled Tree Decoder for Automated Program RepairCode1
Neural Program Repair by Jointly Learning to Localize and RepairCode1
CoSIL: Software Issue Localization via LLM-Driven Code Repository Graph SearchingCode1
RepairBench: Leaderboard of Frontier Models for Program RepairCode1
Break-It-Fix-It: Unsupervised Learning for Program RepairCode1
Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program RepairCode1
Graph-based, Self-Supervised Program Repair from Diagnostic FeedbackCode1
ConDefects: A New Dataset to Address the Data Leakage Concern for LLM-based Fault Localization and Program Repair—0
Collu-Bench: A Benchmark for Predicting Language Model Hallucinations in Code—0
A Study of Vulnerability Repair in JavaScript Programs with Large Language Models—0
Show:102550
← PrevPage 3 of 14Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5—Unverified
2TransformerAccuracy (%)62—Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6—Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678—Unverified