SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 25012550 of 5335 papers

TitleStatusHype
LEATHER: A Framework for Learning to Generate Human-like Text in DialogueCode0
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey0
Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods0
The COVID That Wasn't: Counterfactual Journalism Using GPT0
Towards a Unified Multi-Dimensional Evaluator for Text GenerationCode2
Few-Shot Visual Question Generation: A Novel Task and Benchmark Datasets0
Equi-Tuning: Group Equivariant Fine-Tuning of Pretrained Models0
Scaling Back-Translation with Domain Text Generation for Sign Language Gloss TranslationCode1
Language Model Decoding as Likelihood-Utility AlignmentCode1
DATScore: Evaluating Translation with Data Augmented Translations0
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error SynthesisCode1
CLIP-Diffusion-LM: Apply Diffusion Model on Image CaptioningCode1
Unified Detoxifying and Debiasing in Language Generation via Inference-time Adaptive Optimization0
ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language ModelsCode1
CHARD: Clinical Health-Aware Reasoning Across Dimensions for Text Generation ModelsCode0
BLAB Reporter: Automated journalism covering the Blue AmazonCode0
Bird-Eye Transformers for Text Generation ModelsCode3
Comparing Computational Architectures for Automated Journalism0
FedPC: Federated Learning for Language Generation with Personal and Context Preference Embeddings0
PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text GenerationCode1
An Analysis of the Effects of Decoding Algorithms on Fairness in Open-Ended Language Generation0
Visualize Before You Write: Imagination-Guided Open-Ended Text GenerationCode1
How Large Language Models are Transforming Machine-Paraphrased PlagiarismCode1
Unsupervised Neural Stylistic Text Generation using Transfer learning and Adapters0
A Unified Encoder-Decoder Framework with Entity MemoryCode1
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training0
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text0
A Distributional Lens for Multi-Aspect Controllable Text GenerationCode1
Unsupervised Sentence Textual Similarity with Compositional Phrase SemanticsCode0
Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similarity0
Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy OptimizationCode1
ContraCLM: Contrastive Learning For Causal Language ModelCode1
A Non-monotonic Self-terminating Language ModelCode0
Faithful Abstractive Summarization via Fact-aware Consistency-constrained TransformerCode0
Comparing BERT-based Reward Functions for Deep Reinforcement Learning in Machine Translation0
FRE at SocialDisNER: Joint Learning of Language Models for Named Entity Recognition0
Investigating Metric Diversity for Evaluating Long Document SummarisationCode0
The COVID That Wasn’t: Counterfactual Journalism Using GPT0
War and Pieces: Comparing Perspectives About World War I and II Across Wikipedia Language Communities0
Few-Shot Pidgin Text Adaptation via Contrastive Fine-Tuning0
CoCGAN: Contrastive Learning for Adversarial Category Text Generation0
Quantifying Bias from Decoding Techniques in Natural Language GenerationCode0
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation0
Programmable Annotation with Diversed Heuristics and Data Denoising0
Building Joint Relationship Attention Network for Image-Text Generation0
Does Meta-learning Help mBERT for Few-shot Question Generation in a Cross-lingual Transfer Setting for Indic Languages?0
BiBL: AMR Parsing and Generation with Bidirectional Bayesian LearningCode0
NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation0
Improving Zero-Shot Multilingual Text Generation via Iterative Distillation0
Analyzing Persuasion Strategies of Debaters on Social Media0
Show:102550
← PrevPage 51 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified