SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2001–2050 of 5335 papers

TitleStatusHype
A Library for Automatic Natural Language Generation of Spanish Texts—0
On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching RegularizationCode0
M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions—0
Large Language Model Pruning—0
Text Generation: A Systematic Literature Review of Tasks, Evaluation, and ChallengesCode0
Model Cascading for Code: A Cascaded Black-Box Multi-Model Framework for Cost-Efficient Code Completion with Self-Testing—0
Linearly Controlled Language Generation with Performative Guarantees—0
Embedding-Aligned Language Models—0
Bayesian WeakS-to-Strong from Text Classification to Generation—0
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMsCode0
Sparse Spectral Training and Inference on Euclidean and Hyperbolic Neural Networks—0
A Misleading Gallery of Fluid Motion by Generative Artificial IntelligenceCode0
Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information—0
T^2 of Thoughts: Temperature Tree Elicits Reasoning in Large Language Models—0
Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language ModelsCode0
Large Language Models (LLMs) Assisted Wireless Network Deployment in Urban Settings—0
Exploration of Masked and Causal Language Modelling for Text Generation—0
CustomText: Customized Textual Image Generation using Diffusion Models—0
ReALLM: A general framework for LLM compression and fine-tuning—0
Quantifying In-Context Reasoning Effects and Memorization Effects in LLMs—0
DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLM—0
WisPerMed at "Discharge Me!": Advancing Text Generation in Healthcare with Large Language Models, Dynamic Expert Selection, and Priming Techniques on MIMIC-IV—0
MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing—0
Assessing Political Bias in Large Language Models—0
Generative Artificial Intelligence: A Systematic Review and Applications—0
SPOR: A Comprehensive and Practical Evaluation Method for Compositional Generalization in Data-to-Text GenerationCode0
Lean Attention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers—0
Automatic News Generation and Fact-Checking System Based on Language Processing—0
Language Models can Evaluate Themselves via Probability DiscrepancyCode0
A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks—0
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models—0
IGOT: Information Gain Optimized Tokenizer on Domain Adaptive Pretraining—0
DEBATE: Devil's Advocate-Based Assessment and Text EvaluationCode0
Thinking Fair and Slow: On the Efficacy of Structured Prompts for Debiasing Language Models—0
Challenges and Opportunities in Text Generation Explainability—0
Reproducing the Metric-Based Evaluation of a Set of Controllable Text Generation Techniques—0
Quite Good, but Not Enough: Nationality Bias in Large Language Models -- A Case Study of ChatGPTCode0
RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning—0
Meta-Learning for Efficient Fine-Tuning of Large Language ModelsCode0
To Each (Textual Sequence) Its Own: Improving Memorized-Data Unlearning in Large Language Models—0
On the performativity of SDG classifications in large bibliometric databases—0
R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models—0
Modern Information Technologies in Scientific Research and Educational Activities—0
Fair Risk Control: A Generalized Framework for Calibrating Multi-group Fairness Risks—0
On the Evaluation of Machine-Generated Reports—0
Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learning—0
Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit's ShowerthoughtsCode0
Controllable Text Generation in the Instruction-Tuning Era—0
Integrating A.I. in Higher Education: Protocol for a Pilot Study with 'SAMCares: An Adaptive Learning Hub'Code0
DynaMo: Accelerating Language Model Inference with Dynamic Multi-Token Sampling—0
Show:102550
← PrevPage 41 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified