SOTAVerified

Language Model Evaluation

The task of using LLMs as evaluators of large language and vision language models.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 69 papers

TitleStatusHype
Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for CodeCode4
Evalverse: Unified and Accessible Library for Large Language Model EvaluationCode3
C^2LEVA: Toward Comprehensive and Contamination-Free Language Model EvaluationCode2
BigBIO: A Framework for Data-Centric Biomedical Natural Language ProcessingCode2
FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsCode2
AgentSims: An Open-Source Sandbox for Large Language Model EvaluationCode2
Template Matters: Understanding the Role of Instruction Templates in Multimodal Language Model Evaluation and TrainingCode1
Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model EvaluationCode1
SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific ResearchCode1
ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract MeaningCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Role-Playing Evaluation for Large Language ModelsCode1
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNACode1
ArabicMMLU: Assessing Massive Multitask Language Understanding in ArabicCode1
MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model EvaluationCode1
Catwalk: A Unified Language Model Evaluation Framework for Many DatasetsCode1
LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test ConstructionCode1
Estimating Contamination via Perplexity: Quantifying Memorisation in Language Model EvaluationCode1
Salmon: A Suite for Acoustic Language Model EvaluationCode1
M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment AnalysisCode1
Branch-Solve-Merge Improves Large Language Model Evaluation and Generation—0
BPoMP: The Benchmark of Poetic Minimal Pairs – Limericks, Rhyme, and Narrative Coherence—0
CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domain—0
Controlling for Stereotypes in Multimodal Language Model Evaluation—0
Beyond Metrics: A Critical Analysis of the Variability in Large Language Model Evaluation Frameworks—0
Show:102550
← PrevPage 1 of 3Next →

No leaderboard results yet.