SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 44014450 of 5335 papers

TitleStatusHype
Estimating Subjective Crowd-Evaluations as an Additional Objective to Improve Natural Language Generation0
Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking0
Eval all, trust a few, do wrong to none: Comparing sentence generation models0
Evaluating a Dynamic Time Warping Based Scoring Algorithm for Facial Expressions in ASL Animations0
Evaluating an Automata Approach to Query Containment0
Evaluating Compact LLMs for Zero-Shot Iberian Language Tasks on End-User Devices0
Evaluating Computational Language Models with Scaling Properties of Natural Language0
Evaluating Consistency and Reasoning Capabilities of Large Language Models0
Evaluating Creative Language Generation: The Case of Rap Lyric Ghostwriting0
Evaluating Durability: Benchmark Insights into Multimodal Watermarking0
Evaluating NLG systems: A brief introduction0
Evaluating the Correctness of Inference Patterns Used by LLMs for Judgment0
Evaluating the Effect of Retrieval Augmentation on Social Biases0
Evaluating the Performance of ChatGPT for Spam Email Detection0
Evaluating the Reliability and Interaction of Recursively Used Feature Classes for Terminology Extraction0
Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge0
Evaluating the text quality, human likeness and tailoring component of PASS: A Dutch data-to-text system for soccer0
Evaluation Guidelines to Deal with Implicit Phenomena to Assess Factuality in Data-to-Text Generation0
Evaluation methodologies in Automatic Question Generation 2013-20180
Evaluation Metrics of Language Generation Models for Synthetic Traffic Generation Tasks0
Evaluation of African American Language Bias in Natural Language Generation0
Evaluation of a Runyankore grammar engine for healthcare messages0
Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian0
Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review0
Evaluation of NMT-Assisted Grammar Transfer for a Multi-Language Configurable Data-to-Text System0
Evaluation of Online Dialogue Policy Learning Techniques0
Evaluation of Text Generation: A Survey0
Evaluation of Thematic Coherence in Microblogs0
Evaluative Pattern Extraction for Automated Text Generation0
Event Graph based Sentence Fusion0
Every picture tells a story: Image-grounded controllable stylistic story generation0
Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation0
Evolutionary perspective on model fine-tuning0
Evolving Knowledge Distillation with Large Language Models and Active Learning0
Exact Sampling and Decoding in High-Order Hidden Markov Models0
Example-based Multilinear Sign Language Generation from a Hierarchical Representation0
Experimental Design to Improve Topic Analysis Based Summarization0
Experimental Evaluation of Machine Learning Models for Goal-oriented Customer Service Chatbot with Pipeline Architecture0
Experiments in Linear Template Combination using Genetic Algorithms0
Experiments with Generative Models for Dependency Tree Linearization0
Experiments with Large Language Models on Retrieval-Augmented Generation for Closed-Source Simulation Software0
Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation0
Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey0
Explainable Autonomy: A Study of Explanation Styles for Building Clear Mental Models0
Explaining Creative Artifacts0
Explaining Face Presentation Attack Detection Using Natural Language0
Explaining Toxic Text via Knowledge Enhanced Text Generation0
Explaining Toxic Text via Knowledge Enhanced Text Generation0
Explaining Violation Traces with Finite State Natural Language Generation Models0
Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex Arguments0
Show:102550
← PrevPage 89 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified