SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2351–2400 of 5335 papers

TitleStatusHype
Critic-Guided Decoding for Controlled Text GenerationCode1
A Mutation-based Text Generation for Adversarial Machine Learning Applications—0
How Does Beam Search improve Span-Level Confidence Estimation in Generative Sequence Labeling?—0
A survey on text generation using generative adversarial networks—0
Ontologically Faithful Generation of Non-Player Character Dialogues—0
WeCheck: Strong Factual Consistency Checker via Weakly Supervised LearningCode0
PairReranker: Pairwise Reranking for Natural Language Generation—0
On the Blind Spots of Model-Based Evaluation Metrics for Text GenerationCode1
On Improving Summarization Factual Consistency from Natural Language FeedbackCode1
SeqDiffuSeq: Text Diffusion with Encoder-Decoder TransformersCode1
BMX: Boosting Natural Language Generation Metrics with ExplainabilityCode0
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning—0
SimpleStyle: An Adaptable Style Transfer Approach—0
Identifying and Manipulating the Personality Traits of Language Models—0
Toward Human-Like Evaluation for Natural Language Generation with Error AnalysisCode1
I Cast Detect Thoughts: Learning to Converse and Guide with Intents and Theory-of-Mind in Dungeons and Dragons—0
Controllable Text Generation with Language Constraints—0
GanLM: Encoder-Decoder Pre-training with an Auxiliary DiscriminatorCode0
Latent Diffusion for Language GenerationCode1
CiteBench: A benchmark for Scientific Citation Text GenerationCode0
Explanation Regeneration via Information BottleneckCode0
One Embedder, Any Task: Instruction-Finetuned Text EmbeddingsCode4
A Natural Bias for Language Generation Models—0
SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic MistakesCode1
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text GenerationCode1
Empowering Diffusion Models on the Embedding Space for Text GenerationCode1
Synthesis and Evaluation of a Domain-specific Large Data Set for Dungeons & DragonsCode0
Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Data—0
DuNST: Dual Noisy Self Training for Semi-Supervised Controllable Text GenerationCode0
MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation—0
Plansformer: Generating Symbolic Plans using Transformers—0
Controllable Text Generation via Probability Density Estimation in the Latent SpaceCode1
Efficient Long Sequence Modeling via State Space Augmented TransformerCode1
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning—0
ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming LanguagesCode6
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods—0
ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenes—0
Collaborating Heterogeneous Natural Language Processing Tasks via Federated Learning—0
The Turing Deception—0
Plug-and-Play Recipe Generation with Content Planning—0
Momentum Calibration for Text Generation—0
Memorization of Named Entities in Fine-tuned BERT ModelsCode0
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review—0
Modern French Poetry Generation with RoBERTa and GPT-2—0
Template-based Recruitment Email Generation For Job Recommendation—0
Style transfer and classification in hebrew news items—0
Improved Beam Search for Hallucination Mitigation in Abstractive Summarization—0
Controlled Text Generation using T5 based Encoder-Decoder Soft Prompt Tuning and Analysis of the Utility of Generated Text in AI—0
Momentum Decoding: Open-ended Text Generation As Graph ExplorationCode1
Grounded Keys-to-Text Generation: Towards Factual Open-Ended Generation—0
Show:102550
← PrevPage 48 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified