SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 32513300 of 5335 papers

TitleStatusHype
Underreporting of errors in NLG output, and what to do about it0
Logic-Consistency Text Generation from Semantic ParsesCode1
Evaluation Guidelines to Deal with Implicit Phenomena to Assess Factuality in Data-to-Text Generation0
Structure-to-Text Generation with Self-Training, Acceptability Classifiers and Context-Conditioning for the GEM Shared Task0
GOT: Testing for Originality in Natural Language Generation0
Evaluating Text Generation from Discourse Representation StructuresCode0
Human Perception in Natural Language Generation0
NUIG-DSI’s submission to The GEM Benchmark 20210
TILGAN: Transformer-based Implicit Latent GAN for Diverse and Coherent Text GenerationCode1
Enhancing Language Generation with Effective Checkpoints of Pre-trained Language Model0
Structure-Aware Pre-Training for Table-to-Text Generation0
Generalized Supervised Attention for Text GenerationCode0
Text-in-Context: Token-Level Error Detection for Table-to-Text GenerationCode0
Exploring Structural Encoding for Data-to-Text Generation0
Single Example Can Improve Zero-Shot Data Generation0
Neural Methodius Revisited: Do Discourse Relations Help with Pre-Trained Models Too?Code0
Self-Training for Compositional Neural NLG in Task-Oriented DialogueCode0
TUDA-Reproducibility @ ReproGen: Replicability of Human Evaluation of Text-to-Text and Concept-to-Text Generation0
PIE: A Parallel Idiomatic Expression Corpus for Idiomatic Sentence Generation and Paraphrasing0
All That's `Human' Is Not Gold: Evaluating Human Evaluation of Generated Text0
Mention Flags (MF): Constraining Transformer-based Text GeneratorsCode1
Continuous Language Generative FlowCode1
``I've Seen Things You People Wouldn't Believe'': Hallucinating Entities in GuessWhat?!0
Employing Argumentation Knowledge Graphs for Neural Argument GenerationCode0
Towards Table-to-Text Generation with Numerical ReasoningCode1
TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models0
Improving Encoder by Auxiliary Supervision Tasks for Table-to-Text GenerationCode1
Multilingual Speech Translation from Efficient Finetuning of Pretrained Models0
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation0
How Helpful is Inverse Reinforcement Learning for Table-to-Text Generation?Code0
POS-Constrained Parallel Decoding for Non-autoregressive GenerationCode0
De-Confounded Variational Encoder-Decoder for Logical Table-to-Text Generation0
XLPT-AMR: Cross-Lingual Pre-Training via Multi-Task Learning for Zero-Shot AMR Parsing and Text GenerationCode0
Ecco: An Open Source Library for the Explainability of Transformer Language ModelsCode2
KuiLeiXi: a Chinese Open-Ended Text Adventure Game0
Avoiding Overlap in Data Augmentation for AMR-to-Text Generation0
BACO: A Background Knowledge- and Content-Based Framework for Citing Sentence Generation0
CSECU-DSG at SemEval-2021 Task 1: Fusion of Transformer Models for Lexical Complexity Prediction0
Towards Generative Aspect-Based Sentiment AnalysisCode1
Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers0
Neural Rule-Execution Tracking Machine For Transformer-Based Text Generation0
MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluation0
Guided Generation of Cause and Effect0
WikiGraphs: A Wikipedia Text - Knowledge Graph Paired DatasetCode0
What Do You Get When You Cross Beam Search with Nucleus Sampling?0
Generative Pretraining for Paraphrase Evaluation0
Urdu & Hindi Poetry Generation using Neural Networks0
Intersectional Bias in Causal Language Models0
Tailor: Generating and Perturbing Text with Semantic ControlsCode1
Variational Topic Inference for Chest X-Ray Report Generation0
Show:102550
← PrevPage 66 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified