SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 801–850 of 5335 papers

TitleStatusHype
'Since Lawyers are Males..': Examining Implicit Gender Bias in Hindi Language Generation by LLMs—0
Beyond Accuracy Optimization: Computer Vision Losses for Large Language Model Fine-TuningCode0
Unlocking Memorization in Large Language Models with Dynamic Soft Prompting—0
Balancing LoRA Performance and Efficiency with Simple Shard SharingCode2
Mitigating Unsafe Feedback with Learning Constraints—0
LLMs Can Check Their Own Results to Mitigate Hallucinations in Traffic Understanding Tasks—0
ABHINAW: A method for Automatic Evaluation of Typography within AI-Generated ImagesCode0
LOLA -- An Open-Source Massively Multilingual Large Language ModelCode1
OmniGen: Unified Image GenerationCode7
THaMES: An End-to-End Tool for Hallucination Mitigation and Evaluation in Large Language ModelsCode0
Zero-resource Hallucination Detection for Text Generation via Graph-based Contextual Knowledge Triples Modeling—0
MGSA: Multi-Granularity Graph Structure Attention for Knowledge Graph-to-Text Generation—0
ReflectDiffu:Reflect between Emotion-intent Contagion and Mimicry for Empathetic Response Generation via a RL-Diffusion Framework—0
PersonaMark: Personalized LLM watermarking for model protection and user attribution—0
NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training—0
ASFT: Aligned Supervised Fine-Tuning through Absolute LikelihoodCode3
Towards Diverse and Efficient Audio Captioning via Diffusion Models—0
On the Generalizability of Foundation Models for Crop Type MappingCode0
Transformer with Controlled Attention for Synchronous Motion CaptioningCode0
Reranking Laws for Language Generation: A Communication-Theoretic Perspective—0
Enhancing adversarial robustness in Natural Language Inference using explanationsCode1
Ontology-Free General-Domain Knowledge Graph-to-Text Generation Dataset Synthesis using Large Language ModelCode1
Enhancing Large Language Models with Domain-Specific Knowledge: The Case in Topological Materials—0
Table-to-Text Generation with Pretrained Diffusion Models—0
Identity-related Speech Suppression in Generative AI Content Moderation—0
DiffusionPen: Towards Controlling the Style of Handwritten Text GenerationCode2
LLMs Will Always Hallucinate, and We Need to Live With This—0
Elsevier Arena: Human Evaluation of Chemistry/Biology/Health Foundational Large Language Models—0
Adversarial Attacks on Data AttributionCode0
LoCa: Logit Calibration for Knowledge Distillation—0
Chain-of-Translation Prompting (CoTR): A Novel Prompting Technique for Low Resource Languages—0
One-Shot Diffusion Mimicker for Handwritten Text GenerationCode4
Bypassing DARCY Defense: Indistinguishable Universal Adversarial Triggers—0
MarS: a Financial Market Simulation Engine Powered by Generative Foundation ModelCode5
Well, that escalated quickly: The Single-Turn Crescendo Attack (STCA)Code0
CLUE: Concept-Level Uncertainty Estimation for Large Language Models—0
How Privacy-Savvy Are Large Language Models? A Case Study on Compliance and Privacy Technical Review—0
OpenFact at CheckThat! 2024: Combining Multiple Attack Methods for Effective Adversarial Text Generation—0
LLM-Assisted Visual Analytics: Opportunities and Challenges—0
Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs—0
Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling—0
LongGenBench: Benchmarking Long-Form Generation in Long Context LLMsCode1
A Perspective on Literary Metaphor in the Context of Generative AI—0
CLIBE: Detecting Dynamic Backdoors in Transformer-based NLP ModelsCode1
Masked Mixers for Language Generation and RetrievalCode0
Fisher Information guided Purification against Backdoor AttacksCode1
Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer—0
MemLong: Memory-Augmented Retrieval for Long Text ModelingCode2
HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications—0
Making the Most of your Model: Methods for Finetuning and Applying Pretrained Transformers—0
Show:102550
← PrevPage 17 of 107Next →
All datasetsDARTCOCO CaptionsEMNLP2017 WMTReDialCommonGenROCStoriesChinese PoemsCzech restaurant informationOpenWebTextSciQYahoo QuestionsADGEN

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74—Unverified
2FactT5BBLEU48.37—Unverified
3JointGT BaselineBLEU47.51—Unverified
4FactJointGTBLEU47.39—Unverified
5Control Prefixes (T5-large)METEOR0.41—Unverified
6T5METEOR0.12—Unverified
7BARTMETEOR0.11—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95—Unverified
2partGANBLEU-20.91—Unverified
3RankGANBLEU-20.85—Unverified
4RelGAN (100)BLEU-20.85—Unverified
5SeqGANBLEU-20.83—Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96—Unverified
2PPOGANBLEU-20.91—Unverified
3RelGANBLEU-20.88—Unverified
4SeqGANBLEU-20.86—Unverified
5RankGANBLEU-20.78—Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65—Unverified
2CRFRDistinct-30.52—Unverified
3KGSFDistinct-30.43—Unverified
4C2CRSDistinct-30.33—Unverified
5KBRDDistinct-30.3—Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92—Unverified
2BART (TextBox 2.0)CIDEr12.98—Unverified
3BARTMETEOR0.3—Unverified
4T5METEOR0.29—Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (sample)BLEU-134.4—Unverified
2Beam search + A*esque (beam)BLEU-134.4—Unverified
3Beam search + A*esque (greedy)BLEU-134.3—Unverified
4Beam searchBLEU-133.7—Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81—Unverified
2SeqGANBLEU-20.74—Unverified
3LeakGANBLEU-20.46—Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17—Unverified
2TGenMETEOR0.15—Unverified
3TGen+METEOR0.15—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12—Unverified
2GPT2-81M-LOOPeval_loss3.11—Unverified
3GPT2-Hermiteeval_loss2.91—Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6—Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4—Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1—Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1—Unverified
2SA-VAENLL327.5—Unverified
3Aggressive VAENLL326.7—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2—Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62—Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34—Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17—Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1—Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22—Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19—Unverified