SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2801–2850 of 5335 papers

TitleStatusHype
Attention as Grounding: Exploring Textual and Cross-Modal Attention on Entities and Relations in Language-and-Vision TransformerCode0
Improving Controllable Text Generation with Position-Aware Weighted Decoding—0
Mix and Match: Learning-free Controllable Text Generationusing Energy Language ModelsCode1
Leveraging Seq2seq Language Generation for Multi-level Product Issue Identification—0
Detoxifying Language Models with a Toxic Corpus—0
Handling and Presenting Harmful Text in NLP Research—0
NMTScore: A Multilingual Analysis of Translation-based Text Similarity MeasuresCode1
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation—0
Cross-modal Memory Networks for Radiology Report GenerationCode1
Building Knowledge-Grounded Dialogue Systems with Graph-Based Semantic Modeling—0
SkillNet-NLG: General-Purpose Natural Language Generation with a Sparsely Activated Approach—0
Crystal Transformer: Self-learning neural language model for Generative and Tinkering Design of Materials—0
Estimating the Personality of White-Box Language Models—0
Which Discriminator for Cooperative Text Generation?Code1
Spurious Correlations in Reference-Free Evaluation of Text Generation—0
Event Transition Planning for Open-ended Text GenerationCode0
Context-Aware Language Modeling for Goal-Oriented Dialogue Systems—0
AfriWOZ: Corpus for Exploiting Cross-Lingual Transferability for Generation of Dialogues in Low-Resource, African Languages—0
Evaluating Mixed-initiative Conversational Search Systems via User SimulationCode0
Efficient Reinforcement Learning for Unsupervised Controlled Text Generation—0
Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and UnderstandingCode0
On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BARTCode0
Text Revision by On-the-Fly Representation OptimizationCode0
Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model—0
GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text GenerationCode1
Leveraging Reaction-aware Substructures for Retrosynthesis AnalysisCode1
Toward More Effective Human Evaluation for Machine Translation—0
TRUE: Re-evaluating Factual Consistency EvaluationCode4
A Call for Clarity in Beam Search: How It Works and When It StopsCode1
Uniform Complexity for Text GenerationCode0
A Generative Language Model for Few-shot Aspect-Based Sentiment AnalysisCode1
Regularization-based Pruning of Irrelevant Weights in Deep Neural ArchitecturesCode0
Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive LearningCode1
PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization—0
BioBART: Pretraining and Evaluation of A Biomedical Generative Language ModelCode1
Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text GenerationCode0
Knowledge Infused DecodingCode1
CLEVR-X: A Visual Reasoning Dataset for Natural Language ExplanationsCode1
latent-GLAT: Glancing at Latent Variables for Parallel Text GenerationCode1
Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process PriorsCode1
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language GenerationCode0
CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text GenerationCode1
Entity-Centric Query Refinement—0
On the probability-quality paradox in language generation—0
Reproducibility Issues for BERT-based Evaluation MetricsCode0
Neural Pipeline for Zero-Shot Data-to-Text GenerationCode1
On Decoding Strategies for Neural Text Generators—0
Generative Design Ideation: A Natural Language Generation Approach—0
A Roadmap for Big Model—0
Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers—0
Show:102550
← PrevPage 57 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified