SOTAVerified

Code Completion

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 212 papers

TitleStatusHype
Protect Your Secrets: Understanding and Measuring Data Exposure in VSCode Extensions—0
LibEvolutionEval: A Benchmark and Study for Version-Specific Code Generation—0
FastDraft: How to Train Your Draft—0
CoCoP: Enhancing Text Classification with LLM through Code Completion Prompt—0
JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking—0
M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluation—0
KV Prediction for Improved Time to First TokenCode0
CodeCipher: Learning to Obfuscate Source Code Against LLMs—0
Horizon-Length Prediction: Advancing Fill-in-the-Middle Capabilities for Code Generation with Lookahead Planning—0
Statically Contextualizing Large Language Models with Typed Holes—0
MarsCode Agent: AI-native Automated Bug Fixing—0
Retrieval-augmented code completion for local projects using large language models—0
RepoMasterEval: Evaluating Code Completion via Real-World Repositories—0
Black-Box Adversarial Attacks on LLM-Based Code Completion—0
TaskEval: Assessing Difficulty of Code Generation Tasks for Large Language Models—0
Evaluating Long Range Dependency Handling in Code Generation Models using Multi-Step Key Retrieval—0
Curriculum Learning for Small Code Language Models—0
TPIA: Towards Target-specific Prompt Injection Attack against Code-oriented Large Language Models—0
Jailbreak Attacks and Defenses Against Large Language Models: A Survey—0
Measuring memorization in RLHF for code completion—0
CodeGemma: Open Code Models Based on Gemma—0
Chain of Agents: Large Language Models Collaborating on Long-Context Tasks—0
R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Models—0
Model Cascading for Code: A Cascaded Black-Box Multi-Model Framework for Cost-Efficient Code Completion with Self-Testing—0
A Transformer-Based Approach for Smart Invocation of Automatic Code CompletionCode0
Full Line Code Completion: Bringing AI to Desktop—0
Does Your Neural Code Completion Model Use My Code? A Membership Inference ApproachCode0
Rethinking Software Engineering in the Foundation Model Era: From Task-Driven AI Copilots to Goal-Driven AI Pair Programmers—0
Is Next Token Prediction Sufficient for GPT? Exploration on Code Logic Comprehension—0
Stable Code Technical Report—0
Investigating the Performance of Language Models for Completing Code in Functional Programming Languages: a Haskell Case StudyCode0
Repoformer: Selective Retrieval for Repository-Level Code Completion—0
Token Alignment via Character Matching for Subword Completion—0
Insights from the Usage of the Ansible Lightspeed Code Completion Service—0
REPOFUSE: Repository-Level Code Completion with Fused Dual Context—0
Context Composing for Full Line Code Completion—0
Neural Models for Source Code Synthesis and Completion—0
Do Large Code Models Understand Programming Concepts? Counterfactual Analysis for Code Predicates—0
Enhancing LLM-Based Coding Tools through Native Integration of IDE-Derived Static Context—0
OMPGPT: A Generative Pre-trained Transformer Model for OpenMP—0
When Neural Code Completion Models Size up the Situation: Attaining Cheaper and Faster Completion through Dynamic Model InferenceCode0
Traces of Memorisation in Large Language Models for CodeCode0
A Review of Repository Level Prompting for LLMs—0
Breaking the Silence: the Threats of Using LLMs in Software EngineeringCode0
INSPECT: Intrinsic and Systematic Probing Evaluation for Code TransformersCode0
Interpretability Illusions in the Generalization of Simplified Models—0
GenCodeSearchNet: A Benchmark Test Suite for Evaluating Generalization in Programming Language UnderstandingCode0
Past as a Guide: Leveraging Retrospective Learning for Python Code Completion—0
Identifying and Mitigating Vulnerabilities in LLM-Integrated Applications—0
Attention Alignment and Flexible Positional Embeddings Improve Transformer Length Extrapolation—0
Show:102550
← PrevPage 3 of 5Next →
All datasetsSAFIMCodeXGLUE - Github Java CorpusCodeXGLUE - PY150DotPromptsDefects4JRambo Benchmark

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1deepseek-coder-33b-baseAverage69.01—Unverified
2deepseek-coder-6.7b-baseAverage63.4—Unverified
3starcoderbaseAverage55.54—Unverified
4gpt-4-1106-previewAverage53.28—Unverified
5CodeLlama-13b-hfAverage52.78—Unverified
6deepseek-coder-1.3b-baseAverage52.63—Unverified
7CodeLlama-34b-hfAverage49.66—Unverified
8CodeLlama-7b-hfAverage45—Unverified
9gpt-3.5-turbo-0301Average40.86—Unverified
10incoder-6BAverage33.79—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeGPT-adaptedAccuracy (token-level)77.13—Unverified
2CodeT5+ 770MEM (line-level)37.9—Unverified
3CodeT5+ 220MEM (line-level)35.17—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeGPT-adaptedAccuracy (token-level)75.11—Unverified
2CodeT5+ 770MEM (line-level)44.86—Unverified
3CodeT5+ 220MEM (line-level)43.42—Unverified
#ModelMetricClaimedVerifiedStatus
1SantaCoder-MGDCompilation Rate73.03—Unverified
2SantaCoderCompilation Rate59.97—Unverified
3SantaCoderCompilation Rate59.79—Unverified
#ModelMetricClaimedVerifiedStatus
1RamboCompilation Rate76.47—Unverified
2RepoCoderCompilation Rate74.02—Unverified
#ModelMetricClaimedVerifiedStatus
1RamboCompilation Rate61.7—Unverified
2RepoCoderCompilation Rate58.09—Unverified