SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–10 of 132 papers

TitleStatusHype
AutoCodeRover: Autonomous Program ImprovementCode7
Agentless: Demystifying LLM-based Software Engineering AgentsCode7
HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at ScaleCode3
From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical DebuggingCode2
RepairAgent: An Autonomous, LLM-Based Agent for Program RepairCode2
Break-It-Fix-It: Unsupervised Learning for Program RepairCode1
CURE: Code-Aware Neural Machine Translation for Automatic Program RepairCode1
A Syntax-Guided Edit Decoder for Neural Program RepairCode1
CoCoNuT: Combining Context-Aware Neural Translation Models using Ensemble for Program RepairCode1
Aligning the Objective of LLM-based Program RepairCode1
Show:102550
← PrevPage 1 of 14Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5—Unverified
2TransformerAccuracy (%)62—Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6—Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678—Unverified