SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2401–2450 of 5335 papers

TitleStatusHype
Testing LLMs on Code Generation with Varying Levels of Prompt Specificity—0
Model-Based Minimum Bayes Risk Decoding for Text GenerationCode0
The Iron(ic) Melting Pot: Reviewing Human Evaluation in Humour, Irony and Sarcasm Generation—0
Zero-Shot Goal-Directed Dialogue via RL on Imagined Conversations—0
All Should Be Equal in the Eyes of Language Models: Counterfactually Aware Fair Text GenerationCode0
Prompt Sketching for Large Language Models—0
Input Reconstruction Attack against Vertical Federated Large Language Models—0
Multitask Multimodal Prompted Training for Interactive Embodied Task Completion—0
Adapting Pre-trained Generative Models for Extractive Question Answering—0
CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding—0
Grounded Intuition of GPT-Vision's Abilities with Scientific ImagesCode0
Successor Features for Efficient Multisubject Controlled Text Generation—0
The Impact of Preference Agreement in Reinforcement Learning from Human Feedback: A Case Study in Summarization—0
Divergent Token Metrics: Measuring degradation to prune away LLM components -- and optimize quantization—0
Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements—0
Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs—0
Probing Explicit and Implicit Gender Bias through LLM Conditional Text Generation—0
Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP TasksCode0
BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing—0
Automatic Evaluation of Generative Models with Instruction TuningCode0
Improving Factual Consistency of Text Summarization by Adversarially Decoupling Comprehension and Embellishment Abilities of LLMs—0
TLM: Token-Level Masking for TransformersCode0
Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation—0
The Synergy of Speculative Decoding and Batching in Serving Large Language Models—0
Accelerating LLaMA Inference by Enabling Intermediate Layer Decoding via Instruction Tuning with LITE—0
ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text GenerationCode0
''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text—0
An Ensemble Method Based on the Combination of Transformers with Convolutional Neural Networks to Detect Artificially Generated Text—0
Automatic Logical Forms improve fidelity in Table-to-Text generationCode0
FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text GenerationCode0
Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models—0
Critic-Driven Decoding for Mitigating Hallucinations in Data-to-text GenerationCode0
How well can machine-generated texts be identified and can language models be trained to avoid identification?—0
Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones?Code0
Do Stochastic Parrots have Feelings Too? Improving Neural Detection of Synthetic Text via Emotion RecognitionCode0
Octopus: A Multitask Model and Toolkit for Arabic Natural Language Generation—0
Let the Pretrained Language Models "Imagine" for Short Texts Topic Modeling—0
Fidelity-Enriched Contrastive Search: Reconciling the Faithfulness-Diversity Trade-Off in Text GenerationCode0
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text GenerationCode0
Large Search Model: Redefining Search Stack in the Era of LLMs—0
Branch-Solve-Merge Improves Large Language Model Evaluation and Generation—0
DetectGPT-SC: Improving Detection of Text Generated by Large Language Models through Self-Consistency with Masked Predictions—0
Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study—0
Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text GenerationCode0
Geographical Erasure in Language GenerationCode0
Why LLMs Hallucinate, and How to Get (Evidential) Closure: Perceptual, Intensional, and Extensional Learning for Faithful Natural Language Generation—0
AITA Generating Moral Judgements of the Crowd with Reasoning—0
Why Can Large Language Models Generate Correct Chain-of-Thoughts?—0
The Less the Merrier? Investigating Language Representation in Multilingual Models—0
Quality-Diversity through AI Feedback—0
Show:102550
← PrevPage 49 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified