SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1751–1800 of 5335 papers

TitleStatusHype
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language ModelingCode1
Motion2Language, unsupervised learning of synchronized semantic motion segmentationCode1
DemoSG: Demonstration-enhanced Schema-guided Generation for Low-resource Event Extraction—0
Leveraging Large Language Models for Node Generation in Few-Shot Learning on Text-Attributed GraphsCode1
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language ModelsCode1
VLIS: Unimodal Language Models Guide Multimodal Language GenerationCode1
Efficient Model-Agnostic Multi-Group Equivariant Networks—0
One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language ModelsCode0
Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward ModelCode1
EasyGen: Easing Multimodal Generation with BiDiffuser and LLMsCode1
Dont Add, dont Miss: Effective Content Preserving Generation from Pre-Selected Text SpansCode0
Improving Large Language Models in Event Relation Logical PredictionCode1
The Consensus Game: Language Model Generation via Equilibrium Search—0
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination DetectionCode1
Evaluating The Effectiveness of Capsule Neural Network in Toxic Comment Classification using Pre-trained BERT EmbeddingsCode0
GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language ModelsCode0
EIPE-text: Evaluation-Guided Iterative Plan Extraction for Long-Form Narrative Text Generation—0
Ziya-Visual: Bilingual Large Vision-Language Model via Multi-Task Instruction Tuning—0
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language ModelsCode2
Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic EnhancementCode1
OpenLEAF: Open-Domain Interleaved Image-Text Generation and Evaluation—0
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented ModelsCode1
Guided Attention for Interpretable Motion CaptioningCode0
Multimodal Graph Learning for Generative TasksCode1
The Temporal Structure of Language Processing in the Human Brain Corresponds to The Layered Hierarchy of Deep Language Models—0
MatChat: A Large Language Model and Application Service Platform for Materials Science—0
Sparse Fine-tuning for Inference Acceleration of Large Language ModelsCode1
AutoAD II: The Sequel -- Who, When, and What in Movie Audio Description—0
Aligning Language Models with Human Preferences via a Bayesian ApproachCode1
Latent Diffusion Model for DNA Sequence GenerationCode1
Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and BeyondCode0
A Bias-Variance-Covariance Decomposition of Kernel Scores for Generative ModelsCode0
Exploring the Maze of Multilingual Modeling—0
Generative quantum machine learning via denoising diffusion probabilistic modelsCode1
ReZG: Retrieval-Augmented Zero-Shot Counter Narrative Generation for Hate SpeechCode0
RAC-BERT: Character Radical Enhanced BERT for Ancient ChineseCode0
Factuality Challenges in the Era of Large Language Models—0
Do Large Language Models Know about Facts?—0
Video-Teller: Enhancing Cross-Modal Generation with Fusion and Decoupling—0
Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning—0
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text GenerationCode1
InstructProtein: Aligning Human and Protein Language via Knowledge Instruction—0
Learning Personalized Alignment for Evaluating Open-ended Text Generation—0
Expedited Training of Visual Conditioned Language Generation via Redundancy ReductionCode0
Automatic and Human-AI Interactive Text Generation—0
Controllable Multi-document Summarization: Coverage & Coherence Intuitive Policy with Large Language Model Based Rewards—0
AGIR: Automating Cyber Threat Intelligence Reporting with Natural Language GenerationCode1
Integrating UMLS Knowledge into Large Language Models for Medical Question AnsweringCode1
Controlling Topic-Focus Articulation in Meaning-to-Text Generation using Graph Neural Networks—0
Large Language Models Cannot Self-Correct Reasoning Yet—0
Show:102550
← PrevPage 36 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified