SOTAVerified

Benchmarking

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 5548 papers

TitleStatusHype
BSBench: will your LLM find the largest prime number?Code0
Debatable Intelligence: Benchmarking LLM Judges via Debate Speech EvaluationCode0
Design of intelligent proofreading system for English translation based on CNN and BERT—0
DIMCIM: A Quantitative Evaluation Framework for Default-mode Diversity and Generalization in Text-to-Image Generative Models—0
VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videos—0
MegaHan97K: A Large-Scale Dataset for Mega-Category Chinese Character Recognition with over 97K CategoriesCode2
HoliSafe: Holistic Safety Benchmarking and Modeling with Safety Meta Token for Vision-Language Model—0
From Standalone LLMs to Integrated Intelligence: A Survey of Compound Al Systems—0
CzechLynx: A Dataset for Individual Identification and Pose Estimation of the Eurasian Lynx—0
A Unified Framework for Provably Efficient Algorithms to Estimate Shapley Values—0
Urania: Differentially Private Insights into AI Use—0
AV-Reasoner: Improving and Benchmarking Clue-Grounded Audio-Visual Counting for MLLMs—0
Seeing in the Dark: Benchmarking Egocentric 3D Vision with the Oxford Day-and-Night Dataset—0
Knowledge-guided Contextual Gene Set Analysis Using Large Language Models—0
MELABenchv1: Benchmarking Large Language Models against Smaller Fine-Tuned Models for Low-Resource Maltese NLP—0
HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language ModelsCode0
MedAgentGym: Training LLM Agents for Code-Based Medical Reasoning at Scale—0
macOSWorld: A Multilingual Interactive Benchmark for GUI AgentsCode1
A Kernel-Based Approach for Accurate Steady-State Detection in Performance Time SeriesCode0
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and MaintenanceCode5
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence—0
Generating Automotive Code: Large Language Models for Software Development and Verification in Safety-Critical Systems—0
CETBench: A Novel Dataset constructed via Transformations over Programs for Benchmarking LLMs for Code-Equivalence Checking—0
N^2: A Unified Python Package and Test Bench for Nearest Neighbor-Based Matrix CompletionCode0
ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid MotionsCode1
AMLgentex: Mobilizing Data-Driven Research to Combat Money Laundering—0
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure ModesCode0
Tactile MNIST: Benchmarking Active Tactile Perception—0
FlowerTune: A Cross-Domain Benchmark for Federated Fine-Tuning of Large Language Models—0
SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation—0
NetPress: Dynamically Generated LLM Benchmarks for Network ApplicationsCode1
Rethinking Machine Unlearning in Image Generation ModelsCode1
FormFactory: An Interactive Benchmarking Suite for Multimodal Form-Filling Agents—0
CVC: A Large-Scale Chinese Value Rule Corpus for Value Alignment of Large Language ModelsCode0
TIIF-Bench: How Does Your T2I Model Follow Your Instructions?—0
Benchmarking Neural Speech Codec Intelligibility with SITool—0
ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code—0
ExpertLongBench: Benchmarking Language Models on Expert-Level Long-Form Generation Tasks with Structured Checklists—0
GSCodec Studio: A Modular Framework for Gaussian Splat CompressionCode2
Greening AI-enabled Systems with Software Engineering: A Research Agenda for Environmentally Sustainable AI Practices—0
ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models—0
CODEMENV: Benchmarking Large Language Models on Code MigrationCode1
ACCESS DENIED INC: The First Benchmark Environment for Sensitivity AwarenessCode0
MedBookVQA: A Systematic and Comprehensive Medical Benchmark Derived from Open-Access BookCode0
The iNaturalist Sounds Dataset—0
AVROBUSTBENCH: Benchmarking the Robustness of Audio-Visual Recognition Models at Test-TimeCode1
Breakpoint: Scalable evaluation of system-level reasoning in LLM code agents—0
PathGene: Benchmarking Driver Gene Mutations and Exon Prediction Using Multicenter Lung Cancer Histopathology Image DatasetCode0
Beyond Atomic Geometry Representations in Materials Science: A Human-in-the-Loop Multimodal FrameworkCode0
GenSpace: Benchmarking Spatially-Aware Image Generation—0
Show:102550
← PrevPage 4 of 111Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4 TurboACC0.56—Unverified