SOTAVerified|Agents Browse Leaderboard About

Language Model Evaluation

The task of using LLMs as evaluators of large language and vision language models.

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 11–20 of 69 papers

Title	Date	Tasks	Status	Hype	Score
Role-Playing Evaluation for Large Language Models	May 19, 2025	Language Model Evaluation	CodeCode Available	1	5
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA	Dec 6, 2024	counterfactualLanguage Model Evaluation	CodeCode Available	1	5
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets	Dec 15, 2023	In-Context LearningLanguage Model Evaluation	CodeCode Available	1	5
LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction	Dec 19, 2023	Language Model EvaluationLanguage Modeling	CodeCode Available	1	5
M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis	Feb 17, 2025	Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)	CodeCode Available	1	5
MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation	Dec 28, 2023	GSM8KLanguage Model Evaluation	CodeCode Available	1	5
ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic	Feb 20, 2024	ArabicMMLULanguage Model Evaluation	CodeCode Available	1	5
C-STS: Conditional Semantic Textual Similarity	May 24, 2023	Information RetrievalLanguage Model Evaluation	CodeCode Available	1	5
SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research	Aug 25, 2023	Language Model EvaluationLanguage Modeling	CodeCode Available	1	5
ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning	Feb 25, 2021	Language Model EvaluationLanguage Modeling	CodeCode Available	1	5

Show:10 25 50

← PrevPage 2 of 7Next →

No leaderboard results yet.