SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1651–1700 of 5335 papers

TitleStatusHype
Enhancing Text Generation in Joint NLG/NLU Learning Through Curriculum Learning, Semi-Supervised Training, and Advanced Optimization Techniques—0
Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-ExplorationCode0
BiasJailbreak:Analyzing Ethical Biases and Jailbreak Vulnerabilities in Large Language ModelsCode0
Disentangling Likes and Dislikes in Personalized Generative Explainable Recommendation—0
Large Language Models are Easily Confused: A Quantitative Metric, Security Implications and Typological Analysis—0
Repetition Neurons: How Do Language Models Produce Repetitions?—0
Jailbreaking LLM-Controlled Robots—0
Debiasing Large Vision-Language Models by Ablating Protected Attribute Representations—0
On A Scale From 1 to 5: Quantifying Hallucination in Faithfulness Evaluation—0
Large Language Models as a Tool for Mining Object Knowledge—0
An Automatic and Cost-Efficient Peer-Review Framework for Language Generation Evaluation—0
PromptExp: Multi-granularity Prompt Explanation of Large Language Models—0
Towards More Effective Table-to-Text Generation: Assessing In-Context Learning and Self-Evaluation with Open-Source Models—0
Survey and Evaluation of Converging Architecture in LLMs based on Footsteps of Operations—0
Improving Instruction-Following in Language Models through Activation Steering—0
Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling—0
OMCAT: Omni Context Aware Transformer—0
Enhancing AI Assisted Writing with One-Shot Implicit Negative FeedbackCode0
QE-EBM: Using Quality Estimators as Energy Loss for Machine Translation—0
Large Language Models Are Active Critics in NLG Evaluation—0
LLM-based Code-Switched Text Generation for Grammatical Error Correction—0
Local and Global Decoding in Text GenerationCode0
Multilingual Controlled Generation And Gold-Standard-Agnostic Evaluation of Code-Mixed Sentences—0
MMAR: Towards Lossless Multi-Modal Auto-Regressive Probabilistic Modeling—0
Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning—0
BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation—0
Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks—0
Jump Your Steps: Optimizing Sampling Schedule of Discrete Diffusion Models—0
Signal Watermark on Large Language ModelsCode0
Guaranteed Generation from Large Language ModelsCode0
Localizing Factual Inconsistencies in Attributable Text GenerationCode0
Integrating Planning into Single-Turn Long-Form Text Generation—0
ParallelSpec: Parallel Drafter for Efficient Speculative Decoding—0
KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from ServerCode0
Decoding Decoded: Understanding Hyperparameter Effects in Open-Ended Text GenerationCode0
Conformal Structured PredictionCode0
RevisEval: Improving LLM-as-a-Judge via Response-Adapted References—0
LLaVA Needs More Knowledge: Retrieval Augmented Natural Language Generation with Knowledge Graph for Explaining Thoracic PathologiesCode0
Empowering Backbone Models for Visual Text Generation with Input Granularity Control and Glyph-Aware Training—0
Graded Suspiciousness of Adversarial Texts to Human—0
Evaluating the Correctness of Inference Patterns Used by LLMs for Judgment—0
Inner-Probe: Discovering Copyright-related Data Generation in LLM Architecture—0
Control Large Language Models via Divide and Conquer—0
Mechanistic Behavior Editing of Language ModelsCode0
PAD: Personalized Alignment of LLMs at Decoding-Time—0
Explicit, Implicit, and Scattered: Revisiting Event Extraction to Capture Complex Arguments—0
On Uncertainty In Natural Language Processing—0
Decoding Game: On Minimax Optimality of Heuristic Text Generation Strategies—0
Crafting Narrative Closures: Zero-Shot Learning with SSM Mamba for Short Story Ending Generation—0
FaithCAMERA: Construction of a Faithful Dataset for Ad Text GenerationCode0
Show:102550
← PrevPage 34 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified