SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 5335 papers

TitleStatusHype
Locally Typical SamplingCode4
What Makes Good In-Context Examples for GPT-3?Code4
Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksCode4
The Diffusion DualityCode3
Long-Context Autoregressive Video Modeling with Next-Frame PredictionCode3
M+: Extending MemoryLLM with Scalable Long-Term MemoryCode3
LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window TransformerCode3
A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessCode3
Scaling up Masked Diffusion Models on TextCode3
ASFT: Aligned Supervised Fine-Tuning through Absolute LikelihoodCode3
BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language ModelsCode3
Controllable Text Generation for Large Language Models: A SurveyCode3
SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation ModelsCode3
MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated CapabilitiesCode3
FusionBench: A Comprehensive Benchmark of Deep Model FusionCode3
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language ModelsCode3
Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation DatasetCode3
Evaluating Text-to-Visual Generation with Image-to-Text GenerationCode3
Simple linear attention language models balance the recall-throughput tradeoffCode3
ChatMusician: Understanding and Generating Music Intrinsically with LLMCode3
Efficient Large Language Models: A SurveyCode3
Emu: Generative Pretraining in MultimodalityCode3
CGCE: A Chinese Generative Chat Evaluation Benchmark for General and Financial DomainsCode3
LLM-Pruner: On the Structural Pruning of Large Language ModelsCode3
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference ChecklistCode3
TextBox 2.0: A Text Generation Library with Pre-trained Language ModelsCode3
Bird-Eye Transformers for Text Generation ModelsCode3
Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry ProfessionalsCode3
Diffusion-LM Improves Controllable Text GenerationCode3
Prefix-Tuning: Optimizing Continuous Prompts for GenerationCode3
The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMsCode2
Seq vs Seq: An Open Suite of Paired Encoders and DecodersCode2
HyperSteer: Activation Steering at Scale with HypernetworksCode2
Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion ModelCode2
Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive SurveyCode2
TextCrafter: Accurately Rendering Multiple Texts in Complex Visual ScenesCode2
Unified Multimodal Discrete DiffusionCode2
Reasoning to Learn from Latent ThoughtsCode2
OmniMamba: Efficient and Unified Multimodal Understanding and Generation via State Space ModelsCode2
WritingBench: A Comprehensive Benchmark for Generative WritingCode2
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization AlignmentCode2
A Survey on Data Contamination for Large Language ModelsCode2
Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent SystemsCode2
A Judge-free LLM Open-ended Generation Benchmark Based on the Distributional HypothesisCode2
Saving 77% of the Parameters in Large Language Models Technical ReportCode2
CodeSteer: Symbolic-Augmented Language Models via Code/Text GuidanceCode2
Where am I? Cross-View Geo-localization with Natural Language DescriptionsCode2
LLM-RG4: Flexible and Factual Radiology Report Generation across Diverse Input ContextsCode2
AutoPatent: A Multi-Agent Framework for Automatic Patent GenerationCode2
OmniFlow: Any-to-Any Generation with Multi-Modal Rectified FlowsCode2
Show:102550
← PrevPage 2 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified