| OpenQDC: Open Quantum Data Commons | Nov 29, 2024 | Benchmarking | CodeCode Available | 2 |
| Perception Test 2024: Challenge Summary and a Novel Hour-Long VideoQA Benchmark | Nov 29, 2024 | BenchmarkingGrounded Video Question Answering | —Unverified | 0 |
| λ: A Benchmark for Data-Efficiency in Long-Horizon Indoor Mobile Manipulation Robotics | Nov 28, 2024 | BenchmarkingDiversity | —Unverified | 0 |
| GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks | Nov 28, 2024 | BenchmarkingObject Counting | CodeCode Available | 2 |
| Consolidating and Developing Benchmarking Datasets for the Nepali Natural Language Understanding Tasks | Nov 28, 2024 | BenchmarkingNatural Language Inference | —Unverified | 0 |
| HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos | Nov 28, 2024 | BenchmarkingObject Tracking | —Unverified | 0 |
| Generating Diverse Synthetic Datasets for Evaluation of Real-life Recommender Systems | Nov 27, 2024 | AutoMLBenchmarking | —Unverified | 0 |
| CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models | Nov 27, 2024 | BenchmarkingEarth Observation | CodeCode Available | 1 |
| Benchmarking Agility and Reconfigurability in Satellite Systems for Tropical Cyclone Monitoring | Nov 27, 2024 | BenchmarkingEarth Observation | —Unverified | 0 |
| Evaluating Generative AI-Enhanced Content: A Conceptual Framework Using Qualitative, Quantitative, and Mixed-Methods Approaches | Nov 26, 2024 | Benchmarking | —Unverified | 0 |
| AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM | Nov 26, 2024 | BenchmarkingText-to-Video Generation | CodeCode Available | 1 |
| Agentic AI for Improving Precision in Identifying Contributions to Sustainable Development Goals | Nov 26, 2024 | BenchmarkingRetrieval | —Unverified | 0 |
| Abnormality-Driven Representation Learning for Radiology Imaging | Nov 25, 2024 | BenchmarkingContrastive Learning | —Unverified | 0 |
| VidHal: Benchmarking Temporal Hallucinations in Vision LLMs | Nov 25, 2024 | BenchmarkingHallucination | CodeCode Available | 1 |
| Machine Learning for the Digital Typhoon Dataset: Extensions to Multiple Basins and New Developments in Representations and Tasks | Nov 25, 2024 | Benchmarkingobject-detection | CodeCode Available | 1 |
| Performance Benchmarking of Psychomotor Skills Using Wearable Devices: An Application in Sport | Nov 25, 2024 | Benchmarking | —Unverified | 0 |
| A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation | Nov 25, 2024 | Active LearningBayesian Inference | —Unverified | 0 |
| Benchmarking Active Learning for NILM | Nov 24, 2024 | Active LearningBenchmarking | —Unverified | 0 |
| ChemSafetyBench: Benchmarking LLM Safety on Chemistry Domain | Nov 23, 2024 | BenchmarkingDiversity | CodeCode Available | 0 |
| Reassessing Layer Pruning in LLMs: New Insights and Methods | Nov 23, 2024 | BenchmarkingGPU | CodeCode Available | 0 |
| Benchmarking the Robustness of Optical Flow Estimation to Corruptions | Nov 22, 2024 | Autonomous DrivingBenchmarking | CodeCode Available | 0 |
| AdamZ: An Enhanced Optimisation Method for Neural Network Training | Nov 22, 2024 | Benchmarking | CodeCode Available | 0 |
| Benchmarking Multimodal Models for Ukrainian Language Understanding Across Academic and Cultural Domains | Nov 22, 2024 | BenchmarkingCaption Generation | —Unverified | 0 |
| StackEval: Benchmarking LLMs in Coding Assistance | Nov 21, 2024 | Benchmarking | CodeCode Available | 1 |
| Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levels | Nov 21, 2024 | BenchmarkingMachine Translation | CodeCode Available | 0 |
