SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 132 papers

TitleStatusHype
MdEval: Massively Multilingual Code Debugging—0
Semantic-guided Search for Efficient Program Repair with Large Language Models—0
Collu-Bench: A Benchmark for Predicting Language Model Hallucinations in Code—0
In-Context Code-Text Learning for Bimodal Software Engineering—0
Exploring the Potential of Conversational Test Suite Based Program Repair on SWE-bench—0
Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugsCode0
Enhancing Automated Program Repair with Solution Design—0
RePair: Automated Program Repair with Process-based FeedbackCode0
MergeRepair: An Exploratory Study on Merging Task-Specific Adapters in Code LLMs for Automated Program Repair—0
SpecRover: Code Intent Extraction via LLMs—0
Automated C/C++ Program Repair for High-Level Synthesis via Large Language Models—0
NARRepair: Non-Autoregressive Code Generation Model for Automatic Program Repair—0
Automated Program Repair: Emerging trends pose and expose problems for benchmarks—0
Benchmarking Educational Program RepairCode0
Automatic Programming: Large Language Models and Beyond—0
NExT: Teaching Large Language Models to Reason about Code Execution—0
Peer-aided Repairer: Empowering Large Language Models to Repair Advanced Student Assignments—0
To Err is Machine: Vulnerability Detection Challenges LLM Reasoning—0
A Study of Vulnerability Repair in JavaScript Programs with Large Language Models—0
Towards Reliable Evaluation of Neural Program Repair with Natural Robustness TestingCode0
DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Models—0
A Novel Approach for Automatic Program Repair using Round-Trip Translation with Large Language ModelsCode0
Breaking the Silence: the Threats of Using LLMs in Software EngineeringCode0
Out of Context: How important is Local Context in Neural Program Repair?Code0
Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learning—0
Show:102550
← PrevPage 3 of 6Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5—Unverified
2TransformerAccuracy (%)62—Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6—Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678—Unverified