SOTAVerified

Code Documentation Generation

Code Documentation Generation is a supervised task where a code function is the input to the model, and the model generates the documentation for this function.

Description from: CodeTrans: Towards Cracking the Language of Silicone's Code Through Self-Supervised Deep Learning and High Performance Computing

Papers

Showing 18 of 8 papers

TitleStatusHype
DocAgent: A Multi-Agent System for Automated Code Documentation GenerationCode3
RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation GenerationCode4
A Comparative Analysis of Large Language Models for Code Documentation Generation0
Assemble Foundation Models for Automatic Code SummarizationCode1
Memorization and Generalization in Neural Code Intelligence ModelsCode0
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingCode1
HAConvGNN: Hierarchical Attention Based Convolutional Graph Neural Network for Code Documentation Generation in Jupyter NotebooksCode0
CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesCode1
Show:102550

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1CodeTrans-MT-LargeSmoothed BLEU-421.87Unverified
2CodeBERT (MLM+RTD)Smoothed BLEU-414.56Unverified
3CodeBERT (MLM)Smoothed BLEU-413.59Unverified
4RoBERTaSmoothed BLEU-413.2Unverified
5pre-train w/ code onlySmoothed BLEU-413.07Unverified
6CodeBERT (RTD)Smoothed BLEU-412.72Unverified
7TransformerSmoothed BLEU-412.57Unverified
8seq2seqSmoothed BLEU-411.42Unverified