SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 23012350 of 5335 papers

TitleStatusHype
Hyperparameter-Free Approach for Faster Minimum Bayes Risk DecodingCode0
SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment0
ReFusion: Improving Natural Language Understanding with Computation-Efficient Retrieval Representation FusionCode0
Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Review0
Unifying Structured Data as Graph for Data-to-Text Pre-Training0
Cheetah: Natural Language Generation for 517 African LanguagesCode0
Detection of Machine-Generated Text: Literature Survey0
A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language ModelsCode0
LLaMA Beyond English: An Empirical Study on Language Capability Transfer0
VISTA-LLAMA: Reducing Hallucination in Video Language Models via Equal Distance to Visual Tokens0
Towards CLIP-driven Language-free 3D Visual Grounding via 2D-3D Relational Enhancement and ConsistencyCode0
OmniParser: A Unified Framework for Text Spotting Key Information Extraction and Table Recognition0
COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training0
Principled Gradient-based Markov Chain Monte Carlo for Text Generation0
AI Content Self-Detection for Transformer-based Large Language Models0
Learning to Generate Text in Arbitrary Writing Styles0
AHAM: Adapt, Help, Ask, Model -- Harvesting LLMs for literature mining0
PersianLLaMA: Towards Building First Persian Large Language Model0
Unlocking the Potential of Large Language Models for Explainable RecommendationsCode0
Making Large Language Models A Better Foundation For Dense Retrieval0
A Group Fairness Lens for Large Language Models0
Diffusion-EXR: Controllable Review Generation for Explainable Recommendation via Diffusion Models0
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue0
Large Language Model (LLM) Bias Index -- LLMBI0
Logic-Scaffolding: Personalized Aspect-Instructed Recommendation Explanation Generation using LLMs0
Assaying on the Robustness of Zero-Shot Machine-Generated Text DetectorsCode0
DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines0
LlaMaVAE: Guiding Large Language Model Generation via Continuous Latent Sentence Spaces0
IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text RecognitionCode0
Instruct-SCTG: Guiding Sequential Controlled Text Generation through Instructions0
Delving Deeper Into Astromorphic Transformers0
Cross-Domain Robustness of Transformer-based Keyphrase Generation0
CoAScore: Chain-of-Aspects Prompting for NLG Evaluation0
Exploring Automatic Text Simplification of German Narrative DocumentsCode0
LLaMAntino: LLaMA 2 Models for Effective Text Generation in Italian Language0
Towards Verifiable Text Generation with Evolving Memory and Self-Reflection0
Fast Sampling via Discrete Non-Markov Diffusion Models with Predetermined Transition TimeCode0
A Survey of Text Watermarking in the Era of Large Language Models0
Astrocyte-Enabled Advancements in Spiking Neural Networks for Large Language Modeling0
Vista-LLaMA: Reliable Video Narrator via Equal Distance to Visual Tokens0
Image Content Generation with Causal ReasoningCode0
Adaptive Compression of the Latent Space in Variational AutoencodersCode0
Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models DecodingCode0
GTA: Gated Toxicity Avoidance for LM Performance PreservationCode0
Unifying Text, Tables, and Images for Multimodal Question AnsweringCode0
Towards Controlled Table-to-Text Generation with Scientific Reasoning0
How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical SurveyCode0
Forcing Generative Models to Degenerate Ones: The Power of Data Poisoning Attacks0
Text as Image: Learning Transferable Adapter for Multi-Label Classification0
A Block Metropolis-Hastings Sampler for Controllable Energy-based Text Generation0
Show:102550
← PrevPage 47 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified