SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 51515200 of 5335 papers

TitleStatusHype
Order-Independence Without Fine TuningCode0
Extrinsic Evaluation of Cultural Competence in Large Language ModelsCode0
Unsupervised Text Embedding Space Generation Using Generative Adversarial Networks for Text SynthesisCode0
Extracting and Encoding: Leveraging Large Language Models and Medical Knowledge to Enhance Radiological Text RepresentationCode0
Paper Abstract Writing through Editing MechanismCode0
PaperRobot: Incremental Draft Generation of Scientific IdeasCode0
BLEU is Not Suitable for the Evaluation of Text SimplificationCode0
SGG: Learning to Select, Guide, and Generate for Keyphrase GenerationCode0
Extending LLMs to New Languages: A Case Study of Llama and Persian AdaptationCode0
SH2: Self-Highlighted Hesitation Helps You Decode More TruthfullyCode0
Cross-Domain Detection of GPT-2-Generated Technical TextCode0
Expository Text Generation: Imitate, Retrieve, ParaphraseCode0
A surprisingly effective out-of-the-box char2char model on the E2E NLG Challenge datasetCode0
Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNetCode0
Specification and Evaluation of Multi-Agent LLM Systems -- Prototype and Cybersecurity ApplicationsCode0
Shape of synth to come: Why we should use synthetic data for English surface realizationCode0
Memorization of Named Entities in Fine-tuned BERT ModelsCode0
The LMU Munich System for the WMT 2020 Unsupervised Machine Translation Shared TaskCode0
A Study of Automatic Metrics for the Evaluation of Natural Language ExplanationsCode0
AdTEC: A Unified Benchmark for Evaluating Text Quality in Search Engine AdvertisingCode0
Exploring Retrieval Augmented Generation in ArabicCode0
Exploring Precision and Recall to assess the quality and diversity of LLMsCode0
Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text GenerationCode0
SHIELD: Evaluation and Defense Strategies for Copyright Compliance in LLM Text GenerationCode0
Critic-Driven Decoding for Mitigating Hallucinations in Data-to-text GenerationCode0
Exploring Naive Approaches to Tell Apart LLMs Productions from Human-written TextCode0
Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record SectionsCode0
CREST: A Joint Framework for Rationalization and Counterfactual Text GenerationCode0
Show, Write, and Retrieve: Entity-aware Article Generation and RetrievalCode0
A Sentiment Consolidation Framework for Meta-Review GenerationCode0
Exploring Conditional Text Generation for Aspect-Based Sentiment AnalysisCode0
Assessing Human Editing Effort on LLM-Generated Texts via Compression-Based Edit DistanceCode0
Signal Watermark on Large Language ModelsCode0
VizSeq: A Visual Analysis Toolkit for Text Generation TasksCode0
PatentEval: Understanding Errors in Patent GenerationCode0
Blacks is to Anger as Whites is to Joy? Understanding Latent Affective Bias in Large Pre-trained Neural Language ModelsCode0
Creative GANs for generating poems, lyrics, and metaphorsCode0
Assaying on the Robustness of Zero-Shot Machine-Generated Text DetectorsCode0
Transformer with Controlled Attention for Synchronous Motion CaptioningCode0
Artificial Intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetryCode0
Pathway2Text: Dataset and Method for Biomedical Pathway Description GenerationCode0
The Myths of Our Time: Fake NewsCode0
ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text GenerationCode0
SimpleNLG-ZH: a Linguistic Realisation Engine for MandarinCode0
Exploring Automatic Text Simplification of German Narrative DocumentsCode0
Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting ModelCode0
PCFG-based Natural Language Interface Improves Generalization for Controlled Text GenerationCode0
Auditing Data Provenance in Text-Generation ModelsCode0
Explanation Regeneration via Information BottleneckCode0
Transforming Multi-Conditioned Generation from Meaning RepresentationCode0
Show:102550
← PrevPage 104 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified