SOTAVerified

Text Generation

Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.

Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.

Further readings:

( Image credit: Adversarial Ranking for Language Generation )

Papers

Showing 18511900 of 5335 papers

TitleStatusHype
Scaled Prompt-Tuning for Few-Shot Natural Language Generation0
Auto-Regressive Next-Token Predictors are Universal LearnersCode1
Cited Text Spans for Citation Text GenerationCode0
Circuit Breaking: Removing Model Behaviors with Targeted AblationCode0
Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity0
Unveiling the potential of large language models in generating semantic and cross-language clones0
Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual TokenizationCode2
Reverse-Engineering Decoding Strategies Given Blackbox Access to a Language Generation System0
LLMCad: Fast and Scalable On-device Large Language Model Inference0
ImageBind-LLM: Multi-modality Instruction TuningCode5
Synthetic Text Generation using Hypergraph Representations0
Parameter Efficient Audio Captioning With Faithful Guidance Using Audio-text Shared Latent Representation0
The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie0
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction TuningCode2
NumHG: A Dataset for Number-Focused Headline GenerationCode0
Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets?Code0
The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 LanguagesCode2
LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language ModelsCode1
Optimizing Factual Accuracy in Text Generation through Dynamic Knowledge Selection0
Reinforcement Learning for Generative AI: A Survey0
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIPCode1
MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Records0
Planning with Logical Graph-based Language Model for Instruction Generation0
GeoExplainer: A Visual Analytics Framework for Spatial Modeling Contextualization and Report GenerationCode0
On the Depth between Beam Search and Exhaustive Search for Text Generation0
Out of the Cage: How Stochastic Parrots Win in Cyber Security EnvironmentsCode1
Adversarial Illusions in Multi-Modal EmbeddingsCode1
CiteTracker: Correlating Image and Text for Visual TrackingCode1
Leveraging Language Model Capabilities for Sound Event Detection0
Dynamic Strategy Chain: Dynamic Zero-Shot CoT for Long Mental Health Support Generation0
Data-to-text Generation for Severely Under-Resourced Languages with GPT-3.5: A Bit of Help Needed from Google TranslateCode0
Red-Teaming Large Language Models using Chain of Utterances for Safety-AlignmentCode1
VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity ControlCode1
A Methodology for Generative Spelling Correction via Natural Spelling Errors Emulation across Multiple Domains and LanguagesCode1
ChatHaruhi: Reviving Anime Character in Reality via Large Language ModelCode4
Uni-NLX: Unifying Textual Explanations for Vision and Vision-Language TasksCode1
Semantic Consistency for Assuring Reliability of Large Language Models0
Enhancing Performance on Seen and Unseen Dialogue Scenarios using Retrieval-Augmented End-to-End Task-Oriented System0
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation0
Teach LLMs to Personalize -- An Approach inspired by Writing Education0
Informed Named Entity Recognition Decoding for Generative Language Models0
Attention Is Not All You Need AnymoreCode0
ChatEval: Towards Better LLM-based Evaluators through Multi-Agent DebateCode2
Can Knowledge Graphs Simplify Text?Code1
Thresh: A Unified, Customizable and Deployable Platform for Fine-Grained Text EvaluationCode0
LLM Self Defense: By Self Examination, LLMs Know They Are Being TrickedCode1
Token-Scaled Logit Distillation for Ternary Weight Generative Language ModelsCode1
Generating Faithful Text From a Knowledge Graph with Noisy Reference Text0
Mirror Diffusion Models0
ZYN: Zero-Shot Reward Models with Yes-No Questions for RLAIFCode1
Show:102550
← PrevPage 38 of 107Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1T5B BaselineBLEU48.74Unverified
2FactT5BBLEU48.37Unverified
3JointGT BaselineBLEU47.51Unverified
4FactJointGTBLEU47.39Unverified
5Control Prefixes (T5-large)METEOR0.41Unverified
6T5METEOR0.12Unverified
7BARTMETEOR0.11Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.95Unverified
2partGANBLEU-20.91Unverified
3RankGANBLEU-20.85Unverified
4RelGAN (100)BLEU-20.85Unverified
5SeqGANBLEU-20.83Unverified
#ModelMetricClaimedVerifiedStatus
1LeakGANBLEU-20.96Unverified
2PPOGANBLEU-20.91Unverified
3RelGANBLEU-20.88Unverified
4SeqGANBLEU-20.86Unverified
5RankGANBLEU-20.78Unverified
#ModelMetricClaimedVerifiedStatus
1UniCRSDistinct-30.65Unverified
2CRFRDistinct-30.52Unverified
3KGSFDistinct-30.43Unverified
4C2CRSDistinct-30.33Unverified
5KBRDDistinct-30.3Unverified
#ModelMetricClaimedVerifiedStatus
1UniLMCIDEr14.92Unverified
2BART (TextBox 2.0)CIDEr12.98Unverified
3BARTMETEOR0.3Unverified
4T5METEOR0.29Unverified
#ModelMetricClaimedVerifiedStatus
1Beam search + A*esque (beam)BLEU-134.4Unverified
2Beam search + A*esque (sample)BLEU-134.4Unverified
3Beam search + A*esque (greedy)BLEU-134.3Unverified
4Beam searchBLEU-133.7Unverified
#ModelMetricClaimedVerifiedStatus
1RankGANBLEU-20.81Unverified
2SeqGANBLEU-20.74Unverified
3LeakGANBLEU-20.46Unverified
#ModelMetricClaimedVerifiedStatus
1TGen++METEOR0.17Unverified
2TGenMETEOR0.15Unverified
3TGen+METEOR0.15Unverified
#ModelMetricClaimedVerifiedStatus
1GPT2-124Meval_loss3.12Unverified
2GPT2-81M-LOOPeval_loss3.11Unverified
3GPT2-Hermiteeval_loss2.91Unverified
#ModelMetricClaimedVerifiedStatus
1LLaMA-65B+CFG (zero-shot)Accuracy96.6Unverified
2LLaMA-30B+CFG (zero-shot)Accuracy96.4Unverified
3LLaMA-13B+CFG (zero-shot)Accuracy95.1Unverified
#ModelMetricClaimedVerifiedStatus
1CNN-VAENLL332.1Unverified
2SA-VAENLL327.5Unverified
3Aggressive VAENLL326.7Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)BLEU-410.2Unverified
#ModelMetricClaimedVerifiedStatus
1STWGAN-GPBLEU-30.62Unverified
#ModelMetricClaimedVerifiedStatus
1PALMROUGE-L41.41Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L64.34Unverified
#ModelMetricClaimedVerifiedStatus
1AEM+AttentionBLEU-114.17Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4ASR65.1Unverified
#ModelMetricClaimedVerifiedStatus
1BART (TextBox 2.0)ROUGE-L42.96Unverified
#ModelMetricClaimedVerifiedStatus
1Graph2SeqBLEU22Unverified
#ModelMetricClaimedVerifiedStatus
1WGANGP + DGflowJS-40.19Unverified