SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2251–2300 of 5335 papers

TitleStatusHype
Automated Query Generation for Evidence Collection from Web Search Engines—0
Lana: A Language-Capable Navigator for Instruction Following and GenerationCode1
Input-length-shortening and text generation via attention values—0
Diffusion Models in NLP: A Survey—0
Transformer-based Planning for Symbolic RegressionCode1
Large Language Models Know Your Contextual Search Intent: A Prompting Framework for Conversational SearchCode1
Diffusion Models for Non-autoregressive Text Generation: A SurveyCode1
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language GenerationCode1
Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed VideosCode1
Mapping the Design Space of Interactions in Human-AI Text Co-creation Tasks—0
An Overview on Language Models: Recent Developments and Outlook—0
Stealing the Decoding Algorithms of Language ModelsCode0
Cost-Effective Hyperparameter Optimization for Large Language Model Generation InferenceCode4
ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre Identification—0
Is ChatGPT a Good NLG Evaluator? A Preliminary StudyCode1
The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors—0
DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only TrainingCode1
Models See Hallucinations: Evaluating the Factuality in Video Captioning—0
Contrastive Latent Variable Models for Neural Text GenerationCode0
UZH_CLyp at SemEval-2023 Task 9: Head-First Fine-Tuning and ChatGPT Data Generation for Cross-Lingual Learning in Tweet Intimacy Prediction—0
Interactive Text Generation—0
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents—0
A Universal Question-Answering Platform for Knowledge GraphsCode1
TabGenie: A Toolkit for Table-to-Text GenerationCode1
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural NetworksCode2
Inseq: An Interpretability Toolkit for Sequence Generation ModelsCode2
Tailoring Language Generation Models under Total Variation DistanceCode1
Navigating the Grey Area: How Expressions of Uncertainty and Overconfidence Affect Language Models—0
Toward Fairness in Text Generation via Mutual Information Minimization based on Importance Sampling—0
Adapting Knowledge for Few-shot Table-to-Text GenerationCode0
Language-Driven Representation Learning for RoboticsCode2
Improved Training of Mixture-of-Experts Language GANs—0
How Does In-Context Learning Help Prompt Tuning?—0
Improving User Controlled Table-To-Text Generation RobustnessCode0
Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language GenerationCode1
How Good Are GPT Models at Machine Translation? A Comprehensive EvaluationCode1
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt ConstraintsCode1
Towards Unifying Medical Vision-and-Language Pre-training via Soft PromptsCode1
Role of Bias Terms in Dot-Product Attention—0
For Generated Text, Is NLI-Neutral Text the Best Text?Code0
The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systemsCode0
Retrieval-augmented Image CaptioningCode1
Speculative Decoding with Big Little DecoderCode1
BiasTestGPT: Using ChatGPT for Social Bias Testing of Language Models—0
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation—0
Large Scale Multi-Lingual Multi-Modal Summarization DatasetCode0
Investigating the Effect of Relative Positional Embeddings on AMR-to-Text Generation with Structural Adapters—0
A Reparameterized Discrete Diffusion Model for Text GenerationCode1
POSGen: Personalized Opening Sentence Generation for Online Insurance Sales—0
Plan-then-Seam: Towards Efficient Table-to-Text GenerationCode0
Show:102550
← PrevPage 46 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4—Unverified
2Beam search + A*esque (sample)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified