SOTAVerified

nlg evaluation

Evaluate the generated text by NLG (Natural Language Generation) systems, like large language models

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 71 papers

TitleStatusHype
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference ChecklistCode3
Towards a Unified Multi-Dimensional Evaluator for Text GenerationCode2
Themis: A Reference-free NLG Evaluation Language Model with Flexibility and InterpretabilityCode1
Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesCode1
LUNA: A Framework for Language Understanding and Naturalness AssessmentCode1
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement TheoryCode1
G-Eval: NLG Evaluation using GPT-4 with Better Human AlignmentCode1
Is ChatGPT a Good NLG Evaluator? A Preliminary StudyCode1
Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error SynthesisCode1
Active Evaluation: Efficient NLG Evaluation with Few Pairwise ComparisonsCode1
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language GenerationCode1
Long-Form Information Alignment Evaluation Beyond Atomic FactsCode0
Beyond One-Size-Fits-All: Inversion Learning for Highly Effective NLG Evaluation Prompts—0
DeepSeek vs. o3-mini: How Well can Reasoning LLMs Evaluate MT and Summarization?—0
OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMsCode0
Exploring the Multilingual NLG Evaluation Abilities of LLM-Based Evaluators—0
SAGEval: The frontiers of Satisfactory Agent based NLG Evaluation for reference-free open-ended text—0
Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking—0
Analyzing and Evaluating Correlation Measures in NLG Meta-EvaluationCode0
Large Language Models Are Active Critics in NLG Evaluation—0
DHP Benchmark: Are LLMs Good NLG Evaluators?—0
ReFeR: Improving Evaluation and Reasoning through Hierarchy of ModelsCode0
Better than Random: Reliable NLG Human Evaluation with Constrained Active SamplingCode0
Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG EvaluationCode0
Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language ModelsCode0
DEBATE: Devil's Advocate-Based Assessment and Text EvaluationCode0
WaterJudge: Quality-Detection Trade-off when Watermarking Large Language Models—0
Are LLM-based Evaluators Confusing NLG Quality Criteria?Code0
One Prompt To Rule Them All: LLMs for Opinion Summary EvaluationCode0
LLM-based NLG Evaluation: Current Status and Challenges—0
The Pitfalls of Defining Hallucination—0
CoAScore: Chain-of-Aspects Prompting for NLG Evaluation—0
X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects—0
Towards Multiple References Era -- Addressing Data Leakage and Limited Reference Diversity in NLG EvaluationCode0
LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language ModelsCode0
DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question AnsweringCode0
Rethinking Model Evaluation as Narrowing the Socio-Technical Gap—0
Dolphin: A Challenging and Diverse Benchmark for Arabic NLG—0
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying ReferencesCode0
Describe me an Aucklet: Generating Grounded Perceptual Category DescriptionsCode0
CLSE: Corpus of Linguistically Significant EntitiesCode0
Dialect-robust Evaluation of Generated Text—0
NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation—0
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation MetricsCode0
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation – through the Lens of Semantic Similarity Rating—0
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation -- through the Lens of Semantic Similarity Rating—0
The Authenticity Gap in Human Evaluation—0
Near-Negative Distinction: Giving a Second Life to Human Evaluation DatasetsCode0
Deconstructing NLG Evaluation: Evaluation Practices, Assumptions, and Their Implications—0
Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and UnderstandingCode0
Show:102550
← PrevPage 1 of 2Next →

No leaderboard results yet.