SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 27512800 of 5335 papers

TitleStatusHype
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target TrainingCode0
Privacy-Preserving In-Context Learning for Large Language Models0
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation0
ChatGPT in the Classroom: An Analysis of Its Strengths and Weaknesses for Solving Undergraduate Computer Science Questions0
Text-Blueprint: An Interactive Platform for Plan-based Conditional Generation0
ChatGPT vs State-of-the-Art Models: A Benchmarking Study in Keyphrase Generation Task0
SweCTRL-Mini: a data-transparent Transformer-based large language model for controllable text generation in SwedishCode0
Controlled Text Generation with Natural Language Instructions0
Multidimensional Evaluation for Text Style Transfer Using ChatGPTCode0
Prompting GPT-3.5 for Text-to-SQL with De-semanticization and Skeleton Retrieval0
Evaluating Inter-Bilingual Semantic Parsing for Indian LanguagesCode0
GlyphDiffusion: Text Generation as Image Generation0
Which Factors Predict the Chat Experience of a Natural Language Generation Dialogue Service?0
Joint Repetition Suppression and Content Moderation of Large Language Models0
Controlling keywords and their positions in text generationCode0
Towards Zero-Shot Personalized Table-to-Text Generation with Contrastive Persona Distillation0
An In-depth Investigation of User Response Simulation for Conversational Search0
VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping0
Stochastic Code Generation0
How Useful are Educational Questions Generated by Large Language Models?0
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study0
ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning0
Training Large Language Models Efficiently with Sparsity and Dataflow0
Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder0
GreekBART: The First Pretrained Greek Sequence-to-Sequence ModelCode0
Does Human Collaboration Enhance the Accuracy of Identifying LLM-Generated Deepfake Texts?Code0
AceCoder: Utilizing Existing Code to Enhance Code Generation0
Decoding the End-to-end Writing Trajectory in Scholarly ManuscriptsCode0
CQSumDP: A ChatGPT-Annotated Resource for Query-Focused Abstractive Summarization Based on Debatepedia0
Comparing Abstractive Summaries Generated by ChatGPT to Real Summaries Through Blinded Reviewers and Text Classification Algorithms0
Evaluating NLG systems: A brief introduction0
On Codex Prompt Engineering for OCL Generation: An Empirical Study0
Comparative Analysis of CHATGPT and the evolution of language models0
ChatGPT as a Factual Inconsistency Evaluator for Text Summarization0
AI-Generated Content (AIGC): A Survey0
Large Language Models for Healthcare Data Augmentation: An Example on Patient-Trial Matching0
CoBIT: A Contrastive Bi-directional Image-Text Generation Model0
JaCoText: A Pretrained Model for Java Code-Text Generation0
XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource LanguagesCode0
Code-Switching Text Generation and Injection in Mandarin-English ASR0
Revisiting Automatic Question Summarization Evaluation in the Biomedical Domain0
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models0
Enhancing Text Generation with Cooperative TrainingCode0
DeltaScore: Fine-Grained Story Evaluation with PerturbationsCode0
Automated Query Generation for Evidence Collection from Web Search Engines0
Input-length-shortening and text generation via attention values0
Diffusion Models in NLP: A Survey0
Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks0
An Overview on Language Models: Recent Developments and Outlook0
Stealing the Decoding Algorithms of Language ModelsCode0
Show:102550
← PrevPage 56 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified