| Copilot Evaluation Harness: Evaluating LLM-Guided Software Programming | Feb 22, 2024 | Bug fixingCode Generation | —Unverified | 0 |
| SWE-bench: Can Language Models Resolve Real-World GitHub Issues? | Oct 10, 2023 | Bug fixingCode Generation | CodeCode Available | 4 |
| Bug Characterization in Machine Learning-based Systems | Jul 26, 2023 | Bug fixing | CodeCode Available | 0 |
| SecureFalcon: Are We There Yet in Automated Software Vulnerability Detection with LLMs? | Jul 13, 2023 | Binary ClassificationBug fixing | —Unverified | 0 |
| Model Card and Evaluations for Claude Models | Jul 11, 2023 | Arithmetic ReasoningBug fixing | —Unverified | 0 |
| RAPGen: An Approach for Fixing Code Inefficiencies in Zero-Shot | Jun 29, 2023 | Bug fixingLanguage Modeling | —Unverified | 0 |
| GrACE: Generation using Associated Code Edits | May 23, 2023 | Bug fixingCode Generation | —Unverified | 0 |
| GPT-4 Technical Report | Mar 15, 2023 | answerability predictionArithmetic Reasoning | CodeCode Available | 6 |
| Automating Code-Related Tasks Through Transformers: The Impact of Pre-training | Feb 8, 2023 | Bug fixingCode Completion | CodeCode Available | 0 |
| Detect-Localize-Repair: A Unified Framework for Learning to Debug with CodeT5 | Nov 27, 2022 | Bug fixingLanguage Modeling | —Unverified | 0 |
