| OmniEvalKit: A Modular, Lightweight Toolbox for Evaluating Large Language Model and its Omni-Extensions | Dec 9, 2024 | BenchmarkingLanguage Modeling | —Unverified | 0 |
| Is Self-Supervision Enough? Benchmarking Foundation Models Against End-to-End Training for Mitotic Figure Classification | Dec 9, 2024 | Benchmarking | —Unverified | 0 |
| How Certain are Uncertainty Estimates? Three Novel Earth Observation Datasets for Benchmarking Uncertainty Quantification in Machine Learning | Dec 9, 2024 | BenchmarkingEarth Observation | —Unverified | 0 |
| ONEBench to Test Them All: Sample-Level Benchmarking Over Open-Ended Capabilities | Dec 9, 2024 | AllBenchmarking | —Unverified | 0 |
| Diff5T: Benchmarking Human Brain Diffusion MRI with an Extensive 5.0 Tesla K-Space and Spatial Dataset | Dec 9, 2024 | BenchmarkingDiffusion MRI | —Unverified | 0 |
| Evaluating Robustness of LLMs on Crisis-Related Microblogs across Events, Information Types, and Linguistic Features | Dec 8, 2024 | Benchmarking | —Unverified | 0 |
| Thermal Image-based Fault Diagnosis in Induction Machines via Self-Organized Operational Neural Networks | Dec 8, 2024 | BenchmarkingDiagnostic | —Unverified | 0 |
| A Dataset Similarity Evaluation Framework for Wireless Communications and Sensing | Dec 7, 2024 | BenchmarkingDimensionality Reduction | —Unverified | 0 |
| ACT-Bench: Towards Action Controllable World Models for Autonomous Driving | Dec 6, 2024 | Autonomous DrivingBenchmarking | —Unverified | 0 |
| The BrowserGym Ecosystem for Web Agent Research | Dec 6, 2024 | Benchmarking | CodeCode Available | 5 |
| An Experimental Evaluation of Imputation Models for Spatial-Temporal Traffic Data | Dec 6, 2024 | BenchmarkingImputation | CodeCode Available | 0 |
| Learning Hidden Physics and System Parameters with Deep Operator Networks | Dec 6, 2024 | BenchmarkingUncertainty Quantification | —Unverified | 0 |
| MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objects | Dec 6, 2024 | 2kAnomaly Detection | —Unverified | 0 |
| ConQRet: Benchmarking Fine-Grained Evaluation of Retrieval Augmented Argumentation with LLM Judges | Dec 6, 2024 | BenchmarkingRetrieval | CodeCode Available | 0 |
| MozzaVID: Mozzarella Volumetric Image Dataset | Dec 6, 2024 | BenchmarkingComputed Tomography (CT) | —Unverified | 0 |
| Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Models | Dec 6, 2024 | BenchmarkingDialogue Understanding | —Unverified | 0 |
| From Code to Play: Benchmarking Program Search for Games Using Large Language Models | Dec 5, 2024 | Atari GamesBenchmarking | —Unverified | 0 |
| MegaCOIN: Enhancing Medium-Grained Color Perception for Vision-Language Models | Dec 5, 2024 | BenchmarkingDomain Generalization | —Unverified | 0 |
| Benchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomy | Dec 5, 2024 | BenchmarkingDecoder | —Unverified | 0 |
| Does your model understand genes? A benchmark of gene properties for biological and text models | Dec 5, 2024 | BenchmarkingMulti-class Classification | CodeCode Available | 1 |
| Grounding Descriptions in Images informs Zero-Shot Visual Recognition | Dec 5, 2024 | AttributeBenchmarking | CodeCode Available | 1 |
| T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Concepts | Dec 5, 2024 | BenchmarkingImage Generation | —Unverified | 0 |
| Asynchronous Batch Bayesian Optimization with Pipelining Evaluations for Experimental Resourcex2013constrained Conditions | Dec 5, 2024 | Bayesian OptimizationBenchmarking | CodeCode Available | 0 |
| Uniform Discretized Integrated Gradients: An effective attribution based method for explaining large language models | Dec 5, 2024 | BenchmarkingFeature Importance | —Unverified | 0 |
| ARTeFACT: Benchmarking Segmentation Models on Diverse Analogue Media Damage | Dec 5, 2024 | Benchmarking | —Unverified | 0 |