SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 37013750 of 5335 papers

TitleStatusHype
Training Shallow Phrase Structure Parsers From Semantic Frames and Simple NLG0
Diverse Keyphrase Generation with Neural Unlikelihood TrainingCode0
Learning Better Representation for Tables by Self-Supervised Tasks0
Understanding Neural Abstractive Summarization Models via UncertaintyCode1
Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summaries0
Re-evaluating Evaluation in Text SummarizationCode1
Positioning yourself in the maze of Neural Text Generation: A Task-Agnostic Survey0
Explaining Creative Artifacts0
Random Network Distillation as a Diversity Metric for Both Image and Text Generation0
Incorporating BERT into Parallel Sequence Decoding with AdaptersCode1
Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance0
Improving Text Generation with Student-Forcing Optimal Transport0
Controlled Hallucinations: Learning to Generate Faithfully from Noisy Data0
Back to the Future: Unsupervised Backprop-based Decoding for Counterfactual and Abductive Commonsense ReasoningCode1
Evaluating Factuality in Generation with Dependency-level EntailmentCode1
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training StrategiesCode1
A Sentiment-Controllable Topic-to-Essay Generator with Topic Knowledge Graph0
Controllable Multi-Character Psychology-Oriented Story GenerationCode0
On Long-Tailed Phenomena in Neural Machine TranslationCode1
Adversarial Self-Supervised Data-Free Distillation for Text Classification0
Mark-Evaluate: Assessing Language Generation using Population Estimation Methods0
Online Back-Parsing for AMR-to-Text GenerationCode0
A Survey of Knowledge-Enhanced Text GenerationCode1
Lightweight, Dynamic Graph Convolutional Networks for AMR-to-Text GenerationCode0
Dual Inference for Improving Language Understanding and GenerationCode1
A Cascade Approach to Neural Abstractive Summarization with Content Selection and FusionCode0
Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations0
Toward Stance-based Personas for Opinionated Dialogues0
Narrative Text Generation with a Latent Discrete PlanCode0
RoFT: A Tool for Evaluating Human Detection of Machine-Generated TextCode1
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays0
Plug and Play Autoencoders for Conditional Text GenerationCode1
If beam search is the answer, what was the question?Code1
Investigating African-American Vernacular English in Transformer-Based Text GenerationCode1
Help! Need Advice on Identifying AdviceCode0
GRUEN for Evaluating Linguistic Quality of Generated TextCode1
Stepwise Extractive Summarization and Planning with Structured TransformersCode0
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation0
KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationCode1
Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement LearningCode1
CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation0
Lifelong Language Knowledge DistillationCode1
GenAug: Data Augmentation for Finetuning Text GeneratorsCode1
Viable Threat on News Reading: Generating Biased News Using Natural Language Models0
Transformer-Based Neural Text Generation with Syntactic GuidanceCode1
DLGNet-Task: An End-to-end Neural Network Framework for Modeling Multi-turn Multi-domain Task-Oriented Dialogue0
Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural NetworkCode1
Partially-Aligned Data-to-Text Generation with Distant SupervisionCode1
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models0
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems0
Show:102550
← PrevPage 75 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified