SOTAVerified

Program Repair

Task of teaching ML models to modify an existing program to fix a bug in a given code.

Papers

Showing 126132 of 132 papers

TitleStatusHype
Benchmarking Educational Program RepairCode0
A Novel Approach for Automatic Program Repair using Round-Trip Translation with Large Language ModelsCode0
Towards Reliable Evaluation of Neural Program Repair with Natural Robustness TestingCode0
Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugsCode0
Breaking the Silence: the Threats of Using LLMs in Software EngineeringCode0
Robot Action Selection Learning via Layered Dimension Informed Program SynthesisCode0
Dynamic Neural Program Embedding for Program RepairCode0
Show:102550
← PrevPage 6 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DrRepair + BIFIAverage Success Rate71.7Unverified
2DrRepairAverage Success Rate68.2Unverified
3SampleFixAverage Success Rate45.3Unverified
4RLAssistAverage Success Rate26.6Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer + BIFIAccuracy (%)90.5Unverified
2TransformerAccuracy (%)62Unverified
#ModelMetricClaimedVerifiedStatus
1MGDebugger (DeepSeek-Coder-V2-Lite)Pass@197.6Unverified
#ModelMetricClaimedVerifiedStatus
1TFixError Removal678Unverified