SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 551600 of 5335 papers

TitleStatusHype
Evaluating Factual Consistency of Texts with Semantic Role LabelingCode1
A Frustratingly Simple Decoding Method for Neural Text GenerationCode1
Small Language Models Improve Giants by Rewriting Their OutputsCode1
Explaining How Transformers Use Context to Build PredictionsCode1
LogiCoT: Logical Chain-of-Thought Instruction-TuningCode1
VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language ModelsCode1
BOLT: Fast Energy-based Controlled Text Generation with Tunable BiasesCode1
LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and GenerationCode1
Generating Visual Spatial Description via Holistic 3D Scene UnderstandingCode1
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense RetrievalCode1
Cross-modality Data Augmentation for End-to-End Sign Language TranslationCode1
What You See is What You Read? Improving Text-Image Alignment EvaluationCode1
Pre-Training to Learn in ContextCode1
AR-Diffusion: Auto-Regressive Diffusion Model for Text GenerationCode1
TESS: Text-to-Text Self-Conditioned Simplex DiffusionCode1
Keras GPT Copilot: Integrating the Power of Large Language Models in Deep Learning Model DevelopmentCode1
Watermarking Text Generated by Black-Box Language ModelsCode1
Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!Code1
Lift Yourself Up: Retrieval-augmented Text Generation with Self MemoryCode1
GPTutor: a ChatGPT-powered programming tool for code explanationCode1
The Benefits of Bad Advice: Autocontrastive Decoding across Model LayersCode1
FIREBALL: A Dataset of Dungeons and Dragons Actual-Play with Structured Game State InformationCode1
Summarizing Multiple Documents with Conversational Structure for Meta-Review GenerationCode1
ICE-Score: Instructing Large Language Models to Evaluate CodeCode1
Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text GenerationCode1
LaMP: When Large Language Models Meet PersonalizationCode1
Tractable Control for Autoregressive Language GenerationCode1
WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web CorpusCode1
Prefix tuning for automated audio captioningCode1
G-Eval: NLG Evaluation using GPT-4 with Better Human AlignmentCode1
WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion ModelsCode1
AutoAD: Movie Description in ContextCode1
Synthetically generated text for supervised text analysisCode1
Handwritten Text Generation from Visual ArchetypesCode1
Fine-grained Audible Video DescriptionCode1
Pix2Video: Video Editing using Image DiffusionCode1
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-TuningCode1
Can AI-Generated Text be Reliably Detected?Code1
Lana: A Language-Capable Navigator for Instruction Following and GenerationCode1
Transformer-based Planning for Symbolic RegressionCode1
Diffusion Models for Non-autoregressive Text Generation: A SurveyCode1
Large Language Models Know Your Contextual Search Intent: A Prompting Framework for Conversational SearchCode1
Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed VideosCode1
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language GenerationCode1
Is ChatGPT a Good NLG Evaluator? A Preliminary StudyCode1
DeCap: Decoding CLIP Latents for Zero-Shot Captioning via Text-Only TrainingCode1
A Universal Question-Answering Platform for Knowledge GraphsCode1
TabGenie: A Toolkit for Table-to-Text GenerationCode1
Tailoring Language Generation Models under Total Variation DistanceCode1
Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language GenerationCode1
Show:102550
← PrevPage 12 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4Unverified
2Beam search + A*esque (beam)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified