SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–10 of 132 papers

TitleStatusHype
CORE: Benchmarking LLMs Code Reasoning Capabilities through Static Analysis Tasks—0
T^3: Multi-level Tree-based Automatic Program Repair with Large Language Models—0
Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories—0
Dissecting the SWE-Bench Leaderboards: Profiling Submitters and Architectures of LLM- and Agent-Based Repair Systems—0
SemAgent: A Semantics Aware Program Repair Agent—0
A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair—0
An LLM-as-Judge Metric for Bridging the Gap with Human Evaluation in SE Tasks—0
Gradient-Based Program Repair: Fixing Bugs in Continuous Program Spaces—0
Synthetic Code Surgery: Repairing Bugs and Vulnerabilities with LLMs and Synthetic Data—0
Towards Effectively Leveraging Execution Traces for Program Repair with Code LLMs—0
Show:102550
← PrevPage 1 of 14Next →
All datasetsDeepFixGitHub-PythonHumanEvalPackTFix's Code Patches Data

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7—Unverified
2DrRepairAverage Success Rate68.2—Unverified
3SampleFixAverage Success Rate45.3—Unverified
4RLAssistAverage Success Rate26.6—Unverified