SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2851–2900 of 5335 papers

TitleStatusHype
Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise—0
A Mutation-based Text Generation for Adversarial Machine Learning Applications—0
How Does Beam Search improve Span-Level Confidence Estimation in Generative Sequence Labeling?—0
Commentary Generation from Data Records of Multiplayer Strategy Esports GameCode0
Contrastive Error Attribution for Finetuned Language ModelsCode0
GanLM: Encoder-Decoder Pre-training with an Auxiliary DiscriminatorCode0
BMX: Boosting Natural Language Generation Metrics with ExplainabilityCode0
I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons—0
Ontologically Faithful Generation of Non-Player Character Dialogues—0
PairReranker: Pairwise Reranking for Natural Language Generation—0
WeCheck: Strong Factual Consistency Checker via Weakly Supervised LearningCode0
Controllable Text Generation with Language Constraints—0
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning—0
SimpleStyle: An Adaptable Style Transfer Approach—0
A survey on text generation using generative adversarial networks—0
Identifying and Manipulating the Personality Traits of Language Models—0
Explanation Regeneration via Information BottleneckCode0
CiteBench: A benchmark for Scientific Citation Text GenerationCode0
A Natural Bias for Language Generation Models—0
Synthesis and Evaluation of a Domain-specific Large Data Set for Dungeons & DragonsCode0
Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Data—0
Plansformer: Generating Symbolic Plans using Transformers—0
DuNST: Dual Noisy Self Training for Semi-Supervised Controllable Text GenerationCode0
MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation—0
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning—0
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods—0
ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenes—0
Collaborating Heterogeneous Natural Language Processing Tasks via Federated Learning—0
The Turing Deception—0
Plug-and-Play Recipe Generation with Content Planning—0
Momentum Calibration for Text Generation—0
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review—0
Memorization of Named Entities in Fine-tuned BERT ModelsCode0
Modern French Poetry Generation with RoBERTa and GPT-2—0
Style transfer and classification in hebrew news items—0
Improved Beam Search for Hallucination Mitigation in Abstractive Summarization—0
Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AI—0
Template-based Recruitment Email Generation For Job Recommendation—0
Grounded Keys-to-Text Generation: Towards Factual Open-Ended Generation—0
Towards Robust NLG Bias Evaluation with Syntactically-diverse PromptsCode0
CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text—0
Soft Alignment Objectives for Robust Adaptation of Language GenerationCode0
Controlled Language Generation for Language Learning ItemsCode0
Understanding BLOOM: An empirical study on diverse NLP tasks—0
Lexical Complexity Controlled Sentence Generation—0
Look, Read and Ask: Learning to Ask Questions by Reading Text in Images—0
Retrieval-Augmented Multimodal Language Modeling—0
Best-k Search Algorithm for Neural Text Generation—0
Linear Interpolation In Parameter Space is Good Enough for Fine-Tuned Language Models—0
In-sample Curriculum Learning by Sequence Completion for Natural Language GenerationCode0
Show:102550
← PrevPage 58 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified