SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 26512700 of 5335 papers

TitleStatusHype
Learning Natural Language Generation with Truncated Reinforcement LearningCode0
Aligning Generative Language Models with Human Values0
Don’t Take It Literally: An Edit-Invariant Sequence Loss for Text GenerationCode0
Uncovering Surprising Event Boundaries in Narratives0
RoViST: Learning Robust Metrics for Visual StorytellingCode0
Cross-Domain Detection of GPT-2-Generated Technical TextCode0
The Case for a Single Model that can Both Generate Continuations and Fill-in-the-Blank0
Is neural language acquisition similar to natural? A chronological probing studyCode0
Democratizing Ethical Assessment of Natural Language Generation Models0
Flexible text generation for counterfactual fairness probing0
Joint Generator-Ranker Learning for Natural Language GenerationCode1
On Comparison of Encoders for Attention based End to End Speech Recognition in Standalone and Rescoring Mode0
Evaluation of Semantic Answer Similarity MetricsCode0
Unraveling the Mystery of Artifacts in Machine Generated TextCode0
MVP: Multi-task Supervised Pre-training for Natural Language GenerationCode1
Understanding the Properties of Generated Corpora0
GEMv2: Multilingual NLG Benchmarking in a Single Line of CodeCode1
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic ParsingCode1
Don't Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information0
Plug and Play Counterfactual Text Generation for Model Robustness0
Automatic Controllable Product Copywriting for E-CommerceCode1
A Langevin-like Sampler for Discrete DistributionsCode1
Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt LearningCode1
Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods0
Argumentative Text Generation in Economic DomainCode0
Collocation2Text: Controllable Text Generation from Guide Phrases in Russian0
niksss at HinglishEval: Language-agnostic BERT-based Contextual Embeddings with Catboost for Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish TextCode0
DIALOG-22 RuATD Generated Text DetectionCode0
Interpretable AMR-Based Question Decomposition for Multi-hop Question Answering0
Write and Paint: Generative Vision-Language Models are Unified Modal LearnersCode1
Text Generation with Text-Editing Models0
An Exploration of Post-Editing Effectiveness in Text Summarization0
On the Learning of Non-Autoregressive Transformers0
Grounding in social media: An approach to building a chit-chat dialogue model0
Why is constrained neural language generation particularly challenging?0
Bridging the Gap Between Training and Inference of Bayesian Controllable Language Models0
Factuality Enhanced Language Models for Open-Ended Text GenerationCode5
The Case for a Single Model that can Both Generate Continuations and Fill in the Blank0
Proactively Reducing the Hate Intensity of Online Posts via Hate Speech NormalizationCode1
LegoNN: Building Modular Encoder-Decoder Models0
A Benchmark for Federated Hetero-Task Learning0
Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval0
Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text GenerationCode0
Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text GenerationCode1
Offline RL for Natural Language Generation with Implicit Language Q LearningCode2
Understanding EFL Student Idea Generation Strategies for Creative Writing with NLG Tools0
Automatic Generation of Programming Exercises and Code Explanations using Large Language Models0
Beyond Opinion Mining: Summarizing Opinions of Customer ReviewsCode1
Disentangled Generation Network for Enlarged License Plate Recognition and A Unified Dataset0
Handling Idioms in Symbolic Multilingual Natural Language Generation0
Show:102550
← PrevPage 54 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified