Code Documentation Generation
Code Documentation Generation is a supervised task where a code function is the input to the model, and the model generates the documentation for this function.
Description from: CodeTrans: Towards Cracking the Language of Silicone's Code Through Self-Supervised Deep Learning and High Performance Computing
Papers
Showing 1–8 of 8 papers
All datasetsCodeSearchNet - JavaCodeSearchNet - JavaScriptCodeSearchNet - PhpCodeSearchNetCodeSearchNet - GoCodeSearchNet - PythonCodeSearchNet - Ruby
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeTrans-MT-Large | Smoothed BLEU-4 | 21.87 | — | Unverified |
| 2 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 14.56 | — | Unverified |
| 3 | CodeBERT (MLM) | Smoothed BLEU-4 | 13.59 | — | Unverified |
| 4 | RoBERTa | Smoothed BLEU-4 | 13.2 | — | Unverified |
| 5 | pre-train w/ code only | Smoothed BLEU-4 | 13.07 | — | Unverified |
| 6 | CodeBERT (RTD) | Smoothed BLEU-4 | 12.72 | — | Unverified |
| 7 | Transformer | Smoothed BLEU-4 | 12.57 | — | Unverified |
| 8 | seq2seq | Smoothed BLEU-4 | 11.42 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Transformer | Smoothed BLEU-4 | 25.61 | — | Unverified |
| 2 | CodeTrans-TF-Large | Smoothed BLEU-4 | 18.98 | — | Unverified |
| 3 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 9.54 | — | Unverified |
| 4 | CodeBERT (RTD) | Smoothed BLEU-4 | 8.73 | — | Unverified |
| 5 | CodeBERT (MLM) | Smoothed BLEU-4 | 8.51 | — | Unverified |
| 6 | pre-train w/ code only | Smoothed BLEU-4 | 8.3 | — | Unverified |
| 7 | seq2seq | Smoothed BLEU-4 | 6.88 | — | Unverified |
| 8 | RoBERTa | Smoothed BLEU-4 | 5.72 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeTrans-MT-Base | Smoothed BLEU-4 | 26.23 | — | Unverified |
| 2 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 21.32 | — | Unverified |
| 3 | CodeBERT (MLM) | Smoothed BLEU-4 | 21 | — | Unverified |
| 4 | pre-train w/ code only | Smoothed BLEU-4 | 20.71 | — | Unverified |
| 5 | CodeBERT (RTD) | Smoothed BLEU-4 | 20.25 | — | Unverified |
| 6 | RoBERTa | Smoothed BLEU-4 | 19.9 | — | Unverified |
| 7 | seq2seq | Smoothed BLEU-4 | 18.4 | — | Unverified |
| 8 | Transformer | Smoothed BLEU-4 | 18.25 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 15.99 | — | Unverified |
| 2 | CodeBERT (MLM) | Smoothed BLEU-4 | 15.55 | — | Unverified |
| 3 | pre-train w/ code only | Smoothed BLEU-4 | 15.15 | — | Unverified |
| 4 | CodeBERT (RTD) | Smoothed BLEU-4 | 15.03 | — | Unverified |
| 5 | RoBERTa | Smoothed BLEU-4 | 14.52 | — | Unverified |
| 6 | Transformer | Smoothed BLEU-4 | 14.31 | — | Unverified |
| 7 | seq2seq | Smoothed BLEU-4 | 13.36 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeBERT (MLM) | Smoothed BLEU-4 | 26.79 | — | Unverified |
| 2 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 26.66 | — | Unverified |
| 3 | pre-train w/ code only | Smoothed BLEU-4 | 26.39 | — | Unverified |
| 4 | RoBERTa | Smoothed BLEU-4 | 26.09 | — | Unverified |
| 5 | CodeBERT (RTD) | Smoothed BLEU-4 | 26.02 | — | Unverified |
| 6 | seq2seq | Smoothed BLEU-4 | 23.48 | — | Unverified |
| 7 | CodeTrans-TF-Large | Smoothed BLEU-4 | 19.54 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeTrans-MT-Base | Smoothed BLEU-4 | 20.39 | — | Unverified |
| 2 | CodeBERT (MLM) | Smoothed BLEU-4 | 15.48 | — | Unverified |
| 3 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 15.41 | — | Unverified |
| 4 | pre-train w/ code only | Smoothed BLEU-4 | 15.12 | — | Unverified |
| 5 | RoBERTa | Smoothed BLEU-4 | 14.92 | — | Unverified |
| 6 | Transformer | Smoothed BLEU-4 | 13.44 | — | Unverified |
| 7 | seq2seq | Smoothed BLEU-4 | 13.04 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CodeTrans-MT-Base | Smoothed BLEU-4 | 15.26 | — | Unverified |
| 2 | CodeBERT (MLM+RTD) | Smoothed BLEU-4 | 8.46 | — | Unverified |
| 3 | CodeBERT (MLM) | Smoothed BLEU-4 | 7.95 | — | Unverified |
| 4 | Transformer | Smoothed BLEU-4 | 7.87 | — | Unverified |
| 5 | pre-train w/ code only | Smoothed BLEU-4 | 7.36 | — | Unverified |
| 6 | RoBERTa | Smoothed BLEU-4 | 7.26 | — | Unverified |
| 7 | seq2seq | Smoothed BLEU-4 | 6.96 | — | Unverified |