SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–110 of 132 papers

TitleStatusHype
An Exploratory Literature Study on Sharing and Energy Use of Language Models for Source Code—0
To Err is Machine: Vulnerability Detection Challenges LLM Reasoning—0
A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair—0
Repairing Bugs in Python Assignments Using Large Language Models—0
Repair Is Nearly Generation: Multilingual Program Repair with LLMs—0
Agentic Bug Reproduction for Effective Automated Program Repair at Google—0
Revisiting the Plastic Surgery Hypothesis via Large Language Models—0
Using ML filters to help automated vulnerability repairs: when it helps and when it doesn't—0
RunBugRun -- An Executable Dataset for Automated Program Repair—0
SampleFix: Learning to Generate Functionally Diverse Fixes—0
Show:102550
← PrevPage 11 of 14Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5—Unverified
2TransformerAccuracy (%)62—Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6—Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678—Unverified