SOTAVerified

Code Repair

Papers

Showing 1–25 of 39 papers

TitleStatusHype
CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding Tasks—0
Agent KB: Leveraging Cross-Domain Experience for Agentic Problem SolvingCode3
Breakpoint: Scalable evaluation of system-level reasoning in LLM code agents—0
CrashFixer: A crash resolution agent for the Linux kernel—0
How Accurately Do Large Language Models Understand Code?—0
Why Stop at One Error? Benchmarking LLMs as Data Science Code Debuggers for Multi-Hop and Multi-Bug ErrorsCode0
RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts—0
SolBench: A Dataset and Benchmark for Evaluating Functional Correctness in Solidity Code Completion and Repair—0
AuPair: Golden Example Pairs for Code Repair—0
Fortran2CPP: Automating Fortran-to-C++ Translation using LLMs via Multi-Turn Dialogue and Dual-Agent IntegrationCode1
LLM-Aided Efficient Hardware Design Automation—0
CraftRTL: High-quality Synthetic Data Generation for Verilog Code Models with Correct-by-Construction Non-Textual Representations and Targeted Code RepairCode0
Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairs—0
COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data SynthesisCode1
Is Your AI-Generated Code Really Safe? Evaluating Large Language Models on Secure Code Generation with CodeSecEval—0
Investigating the Transferability of Code Repair for Low-Resource Programming Languages—0
SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code AgentsCode2
Code Repair with LLMs gives an Exploration-Exploitation Tradeoff—0
AutoCoder: Enhancing Code Large Language Model with AIEV-InstructCode4
DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Models—0
Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models—0
Enhanced Automated Code Vulnerability Repair using Large Language Models—0
INTERVENOR: Prompting the Coding Ability of Large Language Models with the Interactive Chain of RepairCode1
Enhancing Large Language Models for Secure Code Generation: A Dataset-driven Study on Vulnerability Mitigation—0
OctoPack: Instruction Tuning Code Large Language ModelsCode3
Show:102550
← PrevPage 1 of 2Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1NSEditAccuracy (medium)13.87—Unverified
2CodeBERTAccuracy (medium)5.2—Unverified