SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2001–2050 of 5335 papers

TitleStatusHype
KEST: Kernel Distance Based Efficient Self-Training for Improving Controllable Text GenerationCode0
Semi-supervised Relation Extraction via Data Augmentation and Consistency-training—0
Semi-Offline Reinforcement Learning for Optimized Text GenerationCode0
Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health—0
Neural models for Factual Inconsistency Classification with ExplanationsCode0
Generate to Understand for RepresentationCode1
MiniLLM: Knowledge Distillation of Large Language ModelsCode2
DiffuDetox: A Mixed Diffusion Model for Text Detoxification—0
PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry GenerationCode0
Unifying Large Language Models and Knowledge Graphs: A Roadmap—0
Question Decomposition Tree for Answering Complex Questions over Knowledge BasesCode1
h2oGPT: Democratizing Large Language ModelsCode6
Adding guardrails to advanced chatbots—0
Emotion and Sentiment Guided Paraphrasing—0
SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking—0
Absformer: Transformer-based Model for Unsupervised Multi-Document Abstractive Summarization—0
Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions—0
Towards End-to-end Speech-to-text SummarizationCode0
Click: Controllable Text Generation with Sequence Likelihood Contrastive LearningCode1
Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue—0
TwistList: Resources and Baselines for Tongue Twister GenerationCode0
Correction of Errors in Preference Ratings from Automated Metrics for Text Generation—0
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingCode4
Structured Voronoi SamplingCode0
Sequential Monte Carlo Steering of Large Language Models using Probabilistic ProgramsCode1
Exposing Bias in Online Communities through Large-Scale Language Models—0
Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference—0
Long Text Generation Challenge—0
A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models—0
Adaptive and Personalized Exercise Generation for Online Language LearningCode1
A two-way translation system of Chinese sign language based on computer vision—0
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingCode2
Binary and Ternary Natural Language GenerationCode1
Preference-grounded Token-level Guidance for Language Model Fine-tuningCode1
Multi-Dimensional Evaluation of Text Summarization with In-Context LearningCode0
Focused Prefix Tuning for Controllable Text Generation—0
FlexRound: Learnable Rounding based on Element-wise Division for Post-Training QuantizationCode0
CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation—0
EEL: Efficiently Encoding Lattices for RerankingCode0
Differentiable Tree Operations Promote Compositional GeneralizationCode1
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback—0
An Invariant Learning Characterization of Controlled Text GenerationCode0
Pre-Trained Language-Meaning Models for Multilingual Parsing and GenerationCode0
Fine-grained Text Style Transfer with Diffusion-Based Language ModelsCode1
Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of MindCode0
Scalable Learning of Latent Language Structure With Logical Offline Cycle Consistency—0
Deliberate then Generate: Enhanced Prompting Framework for Text Generation—0
Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses—0
KEYword based Sampling (KEYS) for Large Language Models—0
Unsupervised Melody-to-Lyric GenerationCode1
Show:102550
← PrevPage 41 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified