SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 23512400 of 5335 papers

TitleStatusHype
Char2char Generation with Reranking for the E2E NLG Challenge0
A Semi-supervised Approach to Generate the Code-Mixed Text using Pre-trained Encoder and Transfer Learning0
AHAM: Adapt, Help, Ask, Model -- Harvesting LLMs for literature mining0
Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation0
Every picture tells a story: Image-grounded controllable stylistic story generation0
Event Graph based Sentence Fusion0
Challenges of Argument Mining: Generating an Argument Synthesis based on the Qualia Structure0
A Group Fairness Lens for Large Language Models0
Evaluative Pattern Extraction for Automated Text Generation0
Evaluation of Thematic Coherence in Microblogs0
Evaluation of Text Generation: A Survey0
A Self-Paced Mixed Distillation Method for Non-Autoregressive Generation0
Evaluation of Online Dialogue Policy Learning Techniques0
Evaluation of NMT-Assisted Grammar Transfer for a Multi-Language Configurable Data-to-Text System0
Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning0
Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review0
Challenges and Opportunities in Text Generation Explainability0
A Self-enhancement Approach for Domain-specific Chatbot Training via Knowledge Mining and Digest0
Graphmax for Text Generation0
Evaluation of Classification Algorithms and Features for Collocation Extraction in Croatian0
Evaluation of a Runyankore grammar engine for healthcare messages0
Evaluation of African American Language Bias in Natural Language Generation0
Evaluation Metrics of Language Generation Models for Synthetic Traffic Generation Tasks0
Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages0
Evaluation methodologies in Automatic Question Generation 2013-20180
Evaluation Guidelines to Deal with Implicit Phenomena to Assess Factuality in Data-to-Text Generation0
Evaluating the text quality, human likeness and tailoring component of PASS: A Dutch data-to-text system for soccer0
Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge0
Chain of Explanation: New Prompting Method to Generate Higher Quality Natural Language Explanation for Implicit Hate Speech0
A Scoping Review of ChatGPT Research in Accounting and Finance0
Adapting SimpleNLG for Brazilian Portuguese realisation0
Absolute and Relative Properties in Geographic Referring Expressions0
Evaluating the Reliability and Interaction of Recursively Used Feature Classes for Terminology Extraction0
Evaluating the Performance of ChatGPT for Spam Email Detection0
CGEMs: A Metric Model for Automatic Code Generation using GPT-30
A Rusty Link in the AI Supply Chain: Detecting Evil Configurations in Model Repositories0
Evaluating the Effect of Retrieval Augmentation on Social Biases0
CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection0
Artwork Explanation in Large-scale Vision Language Models0
Evaluating the Correctness of Inference Patterns Used by LLMs for Judgment0
CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs0
Evaluating NLG systems: A brief introduction0
CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation0
Adapting SimpleNLG for Bilingual English-French Realisation0
A Roadmap for Big Model0
CELL your Model: Contrastive Explanations for Large Language Models0
Efficient Controlled Language Generation with Low-Rank Autoregressive Reward Models0
Evaluating Durability: Benchmark Insights into Multimodal Watermarking0
Evaluating Creative Language Generation: The Case of Rap Lyric Ghostwriting0
Evaluating Consistency and Reasoning Capabilities of Large Language Models0
Show:102550
← PrevPage 48 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified