SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1901–1950 of 5335 papers

TitleStatusHype
Text-Animator: Controllable Visual Text Video Generation—0
Discrete Diffusion Language Model for Long Text Summarization—0
Evaluation of Language Models in the Medical Context Under Resource-Constrained SettingsCode0
Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion ModelsCode0
Directed Domain Fine-Tuning: Tailoring Separate Modalities for Specific Training Tasks—0
Paraphrase and Aggregate with Large Language Models for Minimizing Intent Classification Errors—0
Towards a Science Exocortex—0
Evaluating Diversity in Automatic Poetry GenerationCode0
Robust Reinforcement Learning from Corrupted Human Feedback—0
A Tale of Trust and Accuracy: Base vs. Instruct LLMs in RAG SystemsCode0
A Data-Driven Guided Decoding Mechanism for Diagnostic CaptioningCode0
Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning—0
In Tree Structure Should Sentence Be GeneratedCode0
Generating Educational Materials with Different Levels of Readability using LLMs—0
D2O: Dynamic Discriminative Operations for Efficient Generative Inference of Large Language Models—0
The Comparative Trap: Pairwise Comparisons Amplifies Biased Preferences of LLM Evaluators—0
Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages—0
SHIELD: Evaluation and Defense Strategies for Copyright Compliance in LLM Text GenerationCode0
PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models—0
CodeGemma: Open Code Models Based on Gemma—0
Extrinsic Evaluation of Cultural Competence in Large Language ModelsCode0
GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Training—0
CELL your Model: Contrastive Explanations for Large Language Models—0
Fine-grained Controllable Text Generation through In-context Learning with Feedback—0
Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment—0
LiLiuM: eBay's Large Language Models for e-commerce—0
Incentivizing Quality Text Generation via Statistical ContractsCode0
Post-hoc Utterance Refining Method by Entity Mining for Faithful Knowledge Grounded ConversationsCode0
Identifying Query-Relevant Neurons in Large Language Models for Long-Form TextsCode0
Facts-and-Feelings: Capturing both Objectivity and Subjectivity in Table-to-Text Generation—0
Intertwining CP and NLP: The Generation of Unreasonably Constrained Sentences—0
Integrating Large Language Models with Graph-based Reasoning for Conversational Question Answering—0
A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors—0
A Better LLM Evaluator for Text Generation: The Impact of Prompt Output Sequencing and Optimization—0
FreeCtrl: Constructing Control Centers with Feedforward Layers for Learning-Free Controllable Text GenerationCode0
A Training-free Sub-quadratic Cost Transformer Model Serving Framework With Hierarchically Pruned Attention—0
Improving Autoregressive Training with Dynamic Oracles—0
Modeling Comparative Logical Relation with Contrastive Learning for Text Generation—0
ReadCtrl: Personalizing text generation with readability-controlled instruction learning—0
A Generative Marker Enhanced End-to-End Framework for Argument Mining—0
A Critical Look At Tokenwise Reward-Guided Text Generation—0
Leveraging Large Language Models for Web Scraping—0
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG EvaluationCode0
Analyzing constrained LLM through PDFA-learningCode0
ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMsCode0
Markov Constraint as Large Language Model Surrogate—0
TernaryLLM: Ternarized Large Language Model—0
Write Summary Step-by-Step: A Pilot Study of Stepwise Summarization—0
CERET: Cost-Effective Extrinsic Refinement for Text GenerationCode0
QCQA: Quality and Capacity-aware grouped Query Attention—0
Show:102550
← PrevPage 39 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified