SOTAVerified

Code Documentation Generation

Code Documentation Generation is a supervised task where a code function is the input to the model, and the model generates the documentation for this function.

Description from: CodeTrans: Towards Cracking the Language of Silicone's Code Through Self-Supervised Deep Learning and High Performance Computing

Papers

Showing 18 of 8 papers

TitleStatusHype
DocAgent: A Multi-Agent System for Automated Code Documentation GenerationCode3
RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation GenerationCode4
A Comparative Analysis of Large Language Models for Code Documentation Generation0
Assemble Foundation Models for Automatic Code SummarizationCode1
Memorization and Generalization in Neural Code Intelligence ModelsCode0
CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance ComputingCode1
HAConvGNN: Hierarchical Attention Based Convolutional Graph Neural Network for Code Documentation Generation in Jupyter NotebooksCode0
CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesCode1
Show:102550

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1CodeTrans-MT-BaseSmoothed BLEU-420.39Unverified
2CodeBERT (MLM)Smoothed BLEU-415.48Unverified
3CodeBERT (MLM+RTD)Smoothed BLEU-415.41Unverified
4pre-train w/ code onlySmoothed BLEU-415.12Unverified
5RoBERTaSmoothed BLEU-414.92Unverified
6TransformerSmoothed BLEU-413.44Unverified
7seq2seqSmoothed BLEU-413.04Unverified