SOTAVerified

Code Completion

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 212 papers

TitleStatusHype
Critique Ability of Large Language Models—0
Laminar: A New Serverless Stream-based Framework with Semantic Code Search and Code Completion—0
Identifying and Mitigating the Security Risks of Generative AI—0
CodeMark: Imperceptible Watermarking for Code Datasets against Neural Code Completion ModelsCode0
Benchmarking Causal Study to Interpret Large Language Models for Source Code—0
SecureFalcon: Are We There Yet in Automated Software Vulnerability Detection with LLMs?—0
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review—0
LongCoder: A Long-Range Pre-trained Language Model for Code CompletionCode0
RepoFusion: Training Code Models to Understand Your Repository—0
Large Language Models of Code Fail at Completing Code with Potential BugsCode0
A Static Evaluation of Code Completion by Large Language Models—0
Better Context Makes Better Code Language Models: A Case Study on Function Call Argument Completion—0
Coeditor: Leveraging Contextual Changes for Multi-round Code Auto-editing—0
MERGE: Fast Private Text GenerationCode0
Neural Machine Translation for Code Generation—0
CodeT5+: Open Code Large Language Models for Code Understanding and GenerationCode0
TASTY: A Transformer based Approach to Space and Time complexity—0
Enriching Source Code with Contextual Data for Code Completion Models: An Empirical StudyCode0
CodeKGC: Code Language Model for Generative Knowledge Graph ConstructionCode0
Exploring ChatGPT's Ability to Rank Content: A Preliminary Study on Consistency with Human PreferencesCode0
From Copilot to Pilot: Towards AI Supported Software Development—0
Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completions—0
Automating Code-Related Tasks Through Transformers: The Impact of Pre-trainingCode0
Serenity: Library Based Python Code Analysis for Code Completion and Automated Machine Learning—0
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities—0
MultiCoder: Multi-Programming-Lingual Pre-Training for Low-Resource Code Completion—0
Syntax-Aware On-the-Fly Code CompletionCode0
Text and Patterns: For Effective Chain of Thought, It Takes Two to Tango—0
Don't Complete It! Preventing Unhelpful Code Completion for Productive and Sustainable Neural Code Completion SystemsCode0
HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representations—0
All You Need Is Logs: Improving Code Completion by Learning from Anonymous IDE Usage Logs—0
Compilable Neural Code Generation with Compiler Feedback—0
What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source CodeCode0
Examining Zero-Shot Vulnerability Repair with Large Language Models—0
Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy—0
Time-Efficient Code Completion Model for the R Programming LanguageCode0
Toward Less Hidden Cost of Code Completion with Acceptance and Ranking Models—0
Learning to Complete Code with Sketches—0
Learning to Extend Program Graphs to Work-in-Progress Code—0
Improving Code Autocompletion with Transfer Learning—0
Code Completion by Modeling Flattened Abstract Syntax Trees as Graphs—0
Neural Software AnalysisCode0
Learning to Execute Programs with Instruction Pointer Attention Graph Neural NetworksCode0
On the Embeddings of Variables in Recurrent Neural Networks for Source CodeCode0
Towards Full-line Code Completion with Neural Language Models—0
GraphCodeBERT: Pre-training Code Representations with Data FlowCode0
You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion—0
IntelliCode Compose: Code Generation Using Transformer—0
Fast and Memory-Efficient Neural Code Completion—0
Code Completion using Neural Attention and Byte Pair Encoding—0
Show:102550
← PrevPage 4 of 5Next →
All datasetsSAFIMCodeXGLUE - Github Java CorpusCodeXGLUE - PY150DotPromptsDefects4JRambo Benchmark

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1deepseek-coder-33b-baseAverage69.01—Unverified
2deepseek-coder-6.7b-baseAverage63.4—Unverified
3starcoderbaseAverage55.54—Unverified
4gpt-4-1106-previewAverage53.28—Unverified
5CodeLlama-13b-hfAverage52.78—Unverified
6deepseek-coder-1.3b-baseAverage52.63—Unverified
7CodeLlama-34b-hfAverage49.66—Unverified
8CodeLlama-7b-hfAverage45—Unverified
9gpt-3.5-turbo-0301Average40.86—Unverified
10incoder-6BAverage33.79—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeGPT-adaptedAccuracy (token-level)77.13—Unverified
2CodeT5+ 770MEM (line-level)37.9—Unverified
3CodeT5+ 220MEM (line-level)35.17—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeGPT-adaptedAccuracy (token-level)75.11—Unverified
2CodeT5+ 770MEM (line-level)44.86—Unverified
3CodeT5+ 220MEM (line-level)43.42—Unverified
#ModelMetricClaimedVerifiedStatus
1SantaCoder-MGDCompilation Rate73.03—Unverified
2SantaCoderCompilation Rate59.97—Unverified
3SantaCoderCompilation Rate59.79—Unverified
#ModelMetricClaimedVerifiedStatus
1RamboCompilation Rate76.47—Unverified
2RepoCoderCompilation Rate74.02—Unverified
#ModelMetricClaimedVerifiedStatus
1RamboCompilation Rate61.7—Unverified
2RepoCoderCompilation Rate58.09—Unverified