SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1701–1750 of 5335 papers

TitleStatusHype
Automatic Evaluation of Generative Models with Instruction TuningCode0
Improving Factual Consistency of Text Summarization by Adversarially Decoupling Comprehension and Embellishment Abilities of LLMs—0
LitCab: Lightweight Language Model Calibration over Short- and Long-form ResponsesCode1
The Synergy of Speculative Decoding and Batching in Serving Large Language Models—0
TLM: Token-Level Masking for TransformersCode0
Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation—0
Accelerating LLaMA Inference by Enabling Intermediate Layer Decoding via Instruction Tuning with LITE—0
ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text GenerationCode0
''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text—0
An Ensemble Method Based on the Combination of Transformers with Convolutional Neural Networks to Detect Artificially Generated Text—0
Automatic Logical Forms improve fidelity in Table-to-Text generationCode0
FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text GenerationCode0
How well can machine-generated texts be identified and can language models be trained to avoid identification?—0
Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models—0
Critic-Driven Decoding for Mitigating Hallucinations in Data-to-text GenerationCode0
Octopus: A Multitask Model and Toolkit for Arabic Natural Language Generation—0
Do Stochastic Parrots have Feelings Too? Improving Neural Detection of Synthetic Text via Emotion RecognitionCode0
Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones?Code0
Let the Pretrained Language Models "Imagine" for Short Texts Topic Modeling—0
DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLMCode1
Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study—0
Why LLMs Hallucinate, and How to Get (Evidential) Closure: Perceptual, Intensional, and Extensional Learning for Faithful Natural Language Generation—0
Fidelity-Enriched Contrastive Search: Reconciling the Faithfulness-Diversity Trade-Off in Text GenerationCode0
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text GenerationCode0
Large Search Model: Redefining Search Stack in the Era of LLMs—0
Penalty Decoding: Well Suppress the Self-Reinforcement Effect in Open-Ended Text GenerationCode0
DetectGPT-SC: Improving Detection of Text Generated by Large Language Models through Self-Consistency with Masked Predictions—0
Geographical Erasure in Language GenerationCode0
Branch-Solve-Merge Improves Large Language Model Evaluation and Generation—0
Text generation for dataset augmentation in security classification tasksCode1
AITA Generating Moral Judgements of the Crowd with Reasoning—0
Improving Question Generation with Multi-level Content PlanningCode1
Automatic Unit Test Data Generation and Actor-Critic Reinforcement Learning for Code SynthesisCode1
Why Can Large Language Models Generate Correct Chain-of-Thoughts?—0
The Less the Merrier? Investigating Language Representation in Multilingual Models—0
Towards Understanding Sycophancy in Language ModelsCode1
Quality-Diversity through AI Feedback—0
RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question AnsweringCode0
NameGuess: Column Name Expansion for Tabular DataCode1
Knowledge-Augmented Language Model VerificationCode1
MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal AdapterCode1
Understanding Retrieval Augmentation for Long-Form Question Answering—0
Zero-shot Faithfulness Evaluation for Text Summarization with Foundation Language ModelCode1
InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text GenerationCode0
Exploring Automatic Evaluation Methods based on a Decoder-based LLM for Text Generation—0
Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression—0
Large Language Models can Contrastively Refine their Generation for Better Sentence Representation LearningCode0
Automated Evaluation of Personalized Text Generation using Large Language Models—0
DiffuCom: A novel diffusion model for comment generation—0
Generating Summaries with Controllable Readability LevelsCode1
Show:102550
← PrevPage 35 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified