Code Search
The goal of Code Search is to retrieve code fragments from a large code corpus that most closely match a developer’s intent, which is expressed in natural language.
Papers
No papers found.
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | cpt-code M | Overall | 93.5 | — | Unverified |
| 2 | cpt-code S | Overall | 93.4 | — | Unverified |
| 3 | GraphCodeBERT | Overall | 77.4 | — | Unverified |
| 4 | CodeT5+ 770M | Overall | 77.4 | — | Unverified |
| 5 | CodeT5+ 220M | Overall | 77.1 | — | Unverified |
| 6 | CodeBERT | Overall | 76 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Self-attention | Test MRR | 0.84 | — | Unverified |
| 2 | NBOW | Test MRR | 0.81 | — | Unverified |
| 3 | RNN | Test MRR | 0.77 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeT5+ 770M | MRR | 44.7 | — | Unverified |
| 2 | CodeT5+ 220M | MRR | 43.3 | — | Unverified |
| 3 | CodeBERT | MRR | 27.19 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Uni-SBT | MRR | 0.36 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeBERT | Accuracy | 47.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Voyage-code-002 | nDCG@10 | 56.26 | — | Unverified |