SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3401–3450 of 5335 papers

TitleStatusHype
The Impact of Preference Agreement in Reinforcement Learning from Human Feedback: A Case Study in Summarization—0
The Impact of Rule-Based Text Generation on the Quality of Abstractive Summaries—0
The Iron(ic) Melting Pot: Reviewing Human Evaluation in Humour, Irony and Sarcasm Generation—0
The KBGen Challenge—0
The Last 10 Metres: Using Visual Analysis and Verbal Communication in Guiding Visually Impaired Smartphone Users to Entrances—0
The Law of Knowledge Overshadowing: Towards Understanding, Predicting, and Preventing LLM Hallucination—0
The Less the Merrier? Investigating Language Representation in Multilingual Models—0
The Magnitude of Categories of Texts Enriched by Language Models—0
The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims—0
Beyond the Black Box: A Statistical Model for LLM Reasoning and Inference—0
ThemePro: A Toolkit for the Analysis of Thematic Progression—0
The Methodius Corpus of Rhetorical Discourse Structures and Generated Texts—0
The Morpho-syntactic Annotation of Animacy for a Dependency Parser—0
The Multilingual Affective Soccer Corpus (MASC): Compiling a biased parallel corpus on soccer reportage in English, German and Dutch—0
The Narrow Gate: Localized Image-Text Communication in Vision-Language Models—0
The Natural Language Pipeline, Neural Text Generation and Explainability—0
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures—0
The Open Source Advantage in Large Language Models (LLMs)—0
Theoretical Benefit and Limitation of Diffusion Language Model—0
The PARLANCE mobile application for interactive search in English and Mandarin—0
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation—0
The Pitfalls of Defining Hallucination—0
The Power of Combining Data and Knowledge: GPT-4o is an Effective Interpreter of Machine Learning Models in Predicting Lymph Node Metastasis of Lung Cancer—0
The Pure Poet: How Good is the Subjective Credibility and Stylistic Quality of Literary Short Texts Written with an Artificial Intelligence Tool as Compared to Texts Written by Human Authors?—0
The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction—0
The Rocky Road towards a Swedish FrameNet - Creating SweFN—0
The role of grammar in transition-probabilities of subsequent words in English text—0
The Safety Reminder: A Soft Prompt to Reactivate Delayed Safety Awareness in Vision-Language Models—0
The Science of Detecting LLM-Generated Texts—0
The Secret's in the Word Order: Text-to-Text Generation for Linguistic Steganography—0
The SelectGen Challenge: Finding the Best Training Samples for Few-Shot Neural Text Generation—0
The Solution for the ICCV 2023 1st Scientific Figure Captioning Challenge—0
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation—0
The Structure of Financial Equity Research Reports -- Identification of the Most Frequently Asked Questions in Financial Analyst Reports to Automate Equity Research Using Llama 3 and GPT-4—0
The Surface Realisation Task: Recent Developments and Future Plans—0
The Synergy of Speculative Decoding and Batching in Serving Large Language Models—0
The Task Matters: Comparing Image Captioning and Task-Based Dialogical Image Description—0
The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models—0
The Turing Deception—0
The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)—0
The Use of Object Labels and Spatial Prepositions as Keywords in a Web-Retrieval-Based Image Caption Generation System—0
The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations—0
The WebNLG Challenge: Generating Text from DBPedia Data—0
The WebNLG Challenge: Generating Text from RDF Data—0
Think&Cite: Improving Attributed Text Generation with Self-Guided Tree Search and Progress Reward Modeling—0
Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Models—0
Thinking Outside the (Gray) Box: A Context-Based Score for Assessing Value and Originality in Neural Text Generation—0
Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking—0
“This is a Problem, Don’t You Agree?” Framing and Bias in Human Evaluation for Natural Language Generation—0
Thoughtland: Natural Language Descriptions for Machine Learning n-dimensional Error Functions—0
Show:102550
← PrevPage 69 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified