SOTAVerified

Dialogue Evaluation

Papers

Showing 125 of 97 papers

TitleStatusHype
Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language ModelsCode2
DialogBench: Evaluating LLMs as Human-like Dialogue SystemsCode1
DEnsity: Open-domain Dialogue Evaluation Metric using Density EstimationCode1
GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue GenerationCode1
Don't Forget Your ABC's: Evaluating the State-of-the-Art in Chat-Oriented Dialogue SystemsCode1
FineD-Eval: Fine-grained Automatic Dialogue-Level EvaluationCode1
Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in RussianCode1
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction TuningCode1
RuNNE-2022 Shared Task: Recognizing Nested Named EntitiesCode1
Automatic Evaluation and Moderation of Open-domain Dialogue SystemsCode1
A Comprehensive Assessment of Dialog Evaluation MetricsCode1
Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue UtterancesCode1
DynaEval: Unifying Turn and Dialogue Level EvaluationCode1
Towards Quantifiable Dialogue Coherence EvaluationCode1
Assessing Dialogue Systems with Distribution DistancesCode1
Q^2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question AnsweringCode1
GRADE: Automatic Graph-Enhanced Coherence Metric for Evaluating Open-Domain Dialogue SystemsCode1
Improving Dialog Evaluation with a Multi-reference Adversarial Dataset and Large Scale PretrainingCode1
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue GenerationCode1
Unsupervised Evaluation of Interactive Dialog with DialoGPTCode1
Learning an Unreferenced Metric for Online Dialogue EvaluationCode1
USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationCode1
PONE: A Novel Automatic Evaluation Metric for Open-Domain Generative Dialogue SystemsCode1
RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog SystemsCode1
DRE: An Effective Dual-Refined Method for Integrating Small and Large Language Models in Open-Domain Dialogue Evaluation0
Show:102550
← PrevPage 1 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MDD-EvalSpearman Correlation0.51Unverified
2Lin-Reg (all)Spearman Correlation0.49Unverified
3USRSpearman Correlation0.42Unverified
4USR - DR (x = c)Spearman Correlation0.32Unverified
5USR - MLMSpearman Correlation0.31Unverified
6USR - DR (x = f)Spearman Correlation0.14Unverified
#ModelMetricClaimedVerifiedStatus
1Lin-Reg (all)Spearman Correlation0.54Unverified
2USR - DR (x = c)Spearman Correlation0.48Unverified
3USRSpearman Correlation0.47Unverified
4USR - MLMSpearman Correlation0.08Unverified
5USR - DR (x = f)Spearman Correlation-0.05Unverified