| VisAidMath: Benchmarking Visual-Aided Mathematical Reasoning | Oct 30, 2024 | BenchmarkingHallucination | —Unverified | 0 |
| PC-Gym: Benchmark Environments For Process Control Problems | Oct 29, 2024 | BenchmarkingChemical Process | CodeCode Available | 2 |
| Image2Struct: Benchmarking Structure Extraction for Vision-Language Models | Oct 29, 2024 | Benchmarking | —Unverified | 0 |
| SS3DM: Benchmarking Street-View Surface Reconstruction with a Synthetic 3D Mesh Dataset | Oct 29, 2024 | 3D ReconstructionAutonomous Driving | —Unverified | 0 |
| AI Cyber Risk Benchmark: Automated Exploitation Capabilities | Oct 29, 2024 | BenchmarkingVulnerability Detection | —Unverified | 0 |
| Benchmarking LLM Guardrails in Handling Multilingual Toxicity | Oct 29, 2024 | Benchmarking | —Unverified | 0 |
| Benchmarking Human and Automated Prompting in the Segment Anything Model | Oct 29, 2024 | BenchmarkingImage Segmentation | CodeCode Available | 0 |
| Exploring Capabilities of Time Series Foundation Models in Building Analytics | Oct 28, 2024 | Benchmarkingenergy management | —Unverified | 0 |
| Project MPG: towards a generalized performance benchmark for LLM capabilities | Oct 28, 2024 | BenchmarkingChatbot | —Unverified | 0 |
| LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment | Oct 28, 2024 | BenchmarkingLanguage Modeling | CodeCode Available | 1 |
| NewTerm: Benchmarking Real-Time New Terms for Large Language Models with Annual Updates | Oct 28, 2024 | Benchmarking | CodeCode Available | 0 |
| CODES: Benchmarking Coupled ODE Surrogates | Oct 28, 2024 | BenchmarkingUncertainty Quantification | CodeCode Available | 0 |
| ODRL: A Benchmark for Off-Dynamics Reinforcement Learning | Oct 28, 2024 | Benchmarkingreinforcement-learning | CodeCode Available | 2 |
| LLM-initialized Differentiable Causal Discovery | Oct 28, 2024 | BenchmarkingCausal Discovery | —Unverified | 0 |
| Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training | Oct 28, 2024 | BenchmarkingLanguage Modeling | —Unverified | 0 |
| Hierarchical Knowledge Graph Construction from Images for Scalable E-Commerce | Oct 28, 2024 | Benchmarkinggraph construction | —Unverified | 0 |
| AutoBench-V: Can Large Vision-Language Models Benchmark Themselves? | Oct 28, 2024 | BenchmarkingQuestion Answering | CodeCode Available | 0 |
| CURATe: Benchmarking Personalised Alignment of Conversational AI Assistants | Oct 28, 2024 | Benchmarking | CodeCode Available | 0 |
| BongLLaMA: LLaMA for Bangla Language | Oct 28, 2024 | BenchmarkingData Augmentation | —Unverified | 0 |
| Sequential Large Language Model-Based Hyper-parameter Optimization | Oct 27, 2024 | Bayesian OptimizationBenchmarking | CodeCode Available | 0 |
| SPICEPilot: Navigating SPICE Code Generation and Simulation with AI Guidance | Oct 27, 2024 | BenchmarkingCode Generation | CodeCode Available | 1 |
| Multi-input Multi-output Loewner Framework for Vibration-based Damage Detection on a Trainer Jet | Oct 26, 2024 | BenchmarkingCantilever Beam | —Unverified | 0 |
| OGBench: Benchmarking Offline Goal-Conditioned RL | Oct 26, 2024 | Benchmarkingreinforcement-learning | CodeCode Available | 3 |
| AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels | Oct 26, 2024 | BenchmarkingInformation Retrieval | CodeCode Available | 0 |
| SFTrack: A Robust Scale and Motion Adaptive Algorithm for Tracking Small and Fast Moving Objects | Oct 26, 2024 | BenchmarkingMulti-Object Tracking | —Unverified | 0 |
