SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 5335 papers

TitleStatusHype
Locally Typical SamplingCode4
Leveraging Speculative Sampling and KV-Cache Optimizations Together for Generative AI using OpenVINOCode4
Cost-Effective Hyperparameter Optimization for Large Language Model Generation InferenceCode4
BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language ModelsCode3
FusionBench: A Comprehensive Benchmark of Deep Model FusionCode3
Emu: Generative Pretraining in MultimodalityCode3
ASFT: Aligned Supervised Fine-Tuning through Absolute LikelihoodCode3
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language ModelsCode3
Evaluating Text-to-Visual Generation with Image-to-Text GenerationCode3
Efficient Large Language Models: A SurveyCode3
TextBox 2.0: A Text Generation Library with Pre-trained Language ModelsCode3
The Diffusion DualityCode3
Simple linear attention language models balance the recall-throughput tradeoffCode3
A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessCode3
SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation ModelsCode3
Scaling up Masked Diffusion Models on TextCode3
MM-Vet v2: A Challenging Benchmark to Evaluate Large Multimodal Models for Integrated CapabilitiesCode3
Diffusion-LM Improves Controllable Text GenerationCode3
Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry ProfessionalsCode3
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference ChecklistCode3
Prefix-Tuning: Optimizing Continuous Prompts for GenerationCode3
ChatMusician: Understanding and Generating Music Intrinsically with LLMCode3
M+: Extending MemoryLLM with Scalable Long-Term MemoryCode3
CGCE: A Chinese Generative Chat Evaluation Benchmark for General and Financial DomainsCode3
LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window TransformerCode3
LLM-Pruner: On the Structural Pruning of Large Language ModelsCode3
Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation DatasetCode3
Bird-Eye Transformers for Text Generation ModelsCode3
Controllable Text Generation for Large Language Models: A SurveyCode3
Long-Context Autoregressive Video Modeling with Next-Frame PredictionCode3
HyperSteer: Activation Steering at Scale with HypernetworksCode2
HelloBench: Evaluating Long Text Generation Capabilities of Large Language ModelsCode2
Harmonizing Visual Text Comprehension and GenerationCode2
Improving Factuality and Reasoning in Language Models through Multiagent DebateCode2
Grounding Language Models to Images for Multimodal Inputs and OutputsCode2
HALC: Object Hallucination Reduction via Adaptive Focal-Contrast DecodingCode2
GPT-NER: Named Entity Recognition via Large Language ModelsCode2
AutoPatent: A Multi-Agent Framework for Automatic Patent GenerationCode2
GPTScore: Evaluate as You DesireCode2
Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM InferenceCode2
In-Context Editing: Learning Knowledge from Self-Induced DistributionsCode2
Authorship Obfuscation in Multilingual Machine-Generated Text DetectionCode2
Generative Pretrained Structured Transformers: Unsupervised Syntactic Language Models at ScaleCode2
From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language ModelsCode2
A Touch, Vision, and Language Dataset for Multimodal AlignmentCode2
Few-Shot Text Generation with Pattern-Exploiting TrainingCode2
Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingCode2
A Systematic Survey of Prompt Engineering on Vision-Language Foundation ModelsCode2
Expressive Text-to-Image Generation with Rich TextCode2
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text GenerationCode2
Show:102550
← PrevPage 2 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified