SOTAVerified

Code Search

The goal of Code Search is to retrieve code fragments from a large code corpus that most closely match a developer’s intent, which is expressed in natural language.

Source: When Deep Learning Met Code Search

Papers

Showing 1–10 of 125 papers

TitleStatusHype
AutoCodeRover: Autonomous Program ImprovementCode7
RepoQA: Evaluating Long Context Code UnderstandingCode2
CoIR: A Comprehensive Benchmark for Code Information Retrieval ModelsCode2
CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View GraphsCode2
Search4Code: Code Search Intent Classification Using Weak SupervisionCode1
CodeSearchNet Challenge: Evaluating the State of Semantic Code SearchCode1
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and GenerationCode1
Bridging Pre-trained Models and Downstream Tasks for Source Code UnderstandingCode1
Advanced Detection of Source Code Clones via an Ensemble of Unsupervised Similarity MeasuresCode1
Backdooring Neural Code SearchCode1
Show:102550
← PrevPage 1 of 13Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1cpt-code MOverall93.5—Unverified
2cpt-code SOverall93.4—Unverified
3CodeT5+ 770MOverall77.4—Unverified
4GraphCodeBERTOverall77.4—Unverified
5CodeT5+ 220MOverall77.1—Unverified
6CodeBERTOverall76—Unverified
#ModelMetricClaimedVerifiedStatus
1Self-attentionTest MRR0.84—Unverified
2NBOWTest MRR0.81—Unverified
3RNNTest MRR0.77—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeT5+ 770MMRR44.7—Unverified
2CodeT5+ 220MMRR43.3—Unverified
3CodeBERTMRR27.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SBTMRR0.36—Unverified
#ModelMetricClaimedVerifiedStatus
1CodeBERTAccuracy47.8—Unverified
#ModelMetricClaimedVerifiedStatus
1Voyage-code-002nDCG@1056.26—Unverified