SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 651700 of 5335 papers

TitleStatusHype
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text GenerationCode1
Teacher Forcing Recovers Reward Functions for Text GenerationCode1
RARR: Researching and Revising What Language Models Say, Using Language ModelsCode1
Model Criticism for Long-Form Text GenerationCode1
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text GenerationCode1
Language Model Decoding as Likelihood-Utility AlignmentCode1
Scaling Back-Translation with Domain Text Generation for Sign Language Gloss TranslationCode1
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error SynthesisCode1
CLIP-Diffusion-LM: Apply Diffusion Model on Image CaptioningCode1
ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language ModelsCode1
PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text GenerationCode1
Visualize Before You Write: Imagination-Guided Open-Ended Text GenerationCode1
A Unified Encoder-Decoder Framework with Entity MemoryCode1
How Large Language Models are Transforming Machine-Paraphrased PlagiarismCode1
A Distributional Lens for Multi-Aspect Controllable Text GenerationCode1
Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy OptimizationCode1
ContraCLM: Contrastive Learning For Causal Language ModelCode1
WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from ParagraphsCode1
EditEval: An Instruction-Based Benchmark for Text ImprovementsCode1
PromptCast: A New Prompt-based Learning Paradigm for Time Series ForecastingCode1
The Whole Truth and Nothing But the Truth: Faithful and Controllable Dialogue Response Generation with Dataflow Transduction and Constrained DecodingCode1
Data Feedback Loops: Model-driven Amplification of Dataset BiasesCode1
Multi-Figurative Language GenerationCode1
Multi-Modal Experience Inspired AI CreationCode1
StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content EnhancingCode1
Efficient Task-Oriented Dialogue Systems with Response Selection as an Auxiliary TaskCode1
MENLI: Robust Evaluation Metrics from Natural Language InferenceCode1
Domain-Specific Text Generation for Machine TranslationCode1
Abstractive Meeting Summarization: A SurveyCode1
LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text InjectionCode1
Leveraging Natural Supervision for Language Representation Learning and GenerationCode1
Fuse It More Deeply! A Variational Transformer with Layer-Wise Latent Variable Inference for Text GenerationCode1
Can Language Models Make Fun? A Case Study in Chinese Comical CrosstalkCode1
Joint Generator-Ranker Learning for Natural Language GenerationCode1
MVP: Multi-task Supervised Pre-training for Natural Language GenerationCode1
GEMv2: Multilingual NLG Benchmarking in a Single Line of CodeCode1
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic ParsingCode1
Automatic Controllable Product Copywriting for E-CommerceCode1
A Langevin-like Sampler for Discrete DistributionsCode1
Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt LearningCode1
Write and Paint: Generative Vision-Language Models are Unified Modal LearnersCode1
Proactively Reducing the Hate Intensity of Online Posts via Hate Speech NormalizationCode1
Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text GenerationCode1
Beyond Opinion Mining: Summarizing Opinions of Customer ReviewsCode1
On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic ForgettingCode1
Controllable Text Generation with Neurally-Decomposed OracleCode1
Quark: Controllable Text Generation with Reinforced UnlearningCode1
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text GenerationCode1
Gradient-Based Constrained Sampling from Language ModelsCode1
The Dialog Must Go On: Improving Visual Dialog via Generative Self-TrainingCode1
Show:102550
← PrevPage 14 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified