| Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing | May 5, 2022 | Autonomous DrivingAutonomous Racing | —Unverified | 0 |
| Surface Reconstruction from Point Clouds: A Survey and a Benchmark | May 5, 2022 | BenchmarkingSurface Reconstruction | —Unverified | 0 |
| Creating a Forensic Database of Shoeprints from Online Shoe Tread Photos | May 4, 2022 | BenchmarkingDepth Estimation | CodeCode Available | 1 |
| On Continual Model Refinement in Out-of-Distribution Data Streams | May 4, 2022 | BenchmarkingContinual Learning | —Unverified | 0 |
| Training Mixed-Domain Translation Models via Federated Learning | May 3, 2022 | BenchmarkingFederated Learning | —Unverified | 0 |
| To Find Waldo You Need Contextual Cues: Debiasing Who’s Waldo | May 1, 2022 | BenchmarkingPerson-centric Visual Grounding | CodeCode Available | 0 |
| MMCoQA: Conversational Question Answering over Text, Tables, and Images | May 1, 2022 | BenchmarkingConversational Question Answering | CodeCode Available | 0 |
| MSAMSum: Towards Benchmarking Multi-lingual Dialogue Summarization | May 1, 2022 | Benchmarkingdialogue summary | CodeCode Available | 0 |
| Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension | May 1, 2022 | BenchmarkingQuestion Answering | —Unverified | 0 |
| Benchmarking Post-Hoc Interpretability Approaches for Transformer-based Misogyny Detection | May 1, 2022 | BenchmarkingHate Speech Detection | CodeCode Available | 0 |
| Continual Learning with Foundation Models: An Empirical Study of Latent Replay | Apr 30, 2022 | BenchmarkingContinual Learning | CodeCode Available | 1 |
| Answer Consolidation: Formulation and Benchmarking | Apr 29, 2022 | BenchmarkingQuestion Answering | CodeCode Available | 0 |
| Watts: Infrastructure for Open-Ended Learning | Apr 28, 2022 | Benchmarking | CodeCode Available | 0 |
| A Collection of Quality Diversity Optimization Problems Derived from Hyperparameter Optimization of Machine Learning Models | Apr 28, 2022 | BenchmarkingDiversity | CodeCode Available | 0 |
| Foundations for learning from noisy quantum experiments | Apr 28, 2022 | Benchmarking | —Unverified | 0 |
| Benchmarking the Hooke-Jeeves Method, MTS-LS1, and BSrr on the Large-scale BBOB Function Set | Apr 28, 2022 | Benchmarking | CodeCode Available | 0 |
| Label Anchored Contrastive Learning for Language Understanding | Apr 26, 2022 | BenchmarkingContrastive Learning | —Unverified | 0 |
| Deeper Insights into the Robustness of ViTs towards Common Corruptions | Apr 26, 2022 | BenchmarkingData Augmentation | —Unverified | 0 |
| Causal Reasoning Meets Visual Representation Learning: A Prospective Study | Apr 26, 2022 | BenchmarkingOut-of-Distribution Generalization | —Unverified | 0 |
| Transformation-Interaction-Rational Representation for Symbolic Regression | Apr 25, 2022 | BenchmarkingForm | CodeCode Available | 0 |
| A global analysis of metrics used for measuring performance in natural language processing | Apr 25, 2022 | BenchmarkingMachine Translation | CodeCode Available | 1 |
| MOLE: Digging Tunnels Through Multimodal Multi-Objective Landscapes | Apr 22, 2022 | Benchmarking | CodeCode Available | 0 |
| Changepoint Detection in Noisy Data Using a Novel Residuals Permutation-Based Method (RESPERM): Benchmarking and Application to Single Trial ERPs | Apr 21, 2022 | BenchmarkingChange Point Detection | CodeCode Available | 0 |
| Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics | Apr 21, 2022 | AttributeBenchmarking | —Unverified | 0 |
| Learning to Fold Real Garments with One Arm: A Case Study in Cloud-Based Robotics Research | Apr 21, 2022 | BenchmarkingDiversity | —Unverified | 0 |
| Multi-label classification for biomedical literature: an overview of the BioCreative VII LitCovid Track for COVID-19 literature topic annotations | Apr 20, 2022 | ArticlesBenchmarking | —Unverified | 0 |
| Analyzing the Impact of Undersampling on the Benchmarking and Configuration of Evolutionary Algorithms | Apr 20, 2022 | BenchmarkingEvolutionary Algorithms | —Unverified | 0 |
| K-LITE: Learning Transferable Visual Models with External Knowledge | Apr 20, 2022 | BenchmarkingDescriptive | CodeCode Available | 2 |
| Radio Galaxy Zoo: Using semi-supervised learning to leverage large unlabelled data-sets for radio galaxy classification under data-set shift | Apr 19, 2022 | BenchmarkingClassification | CodeCode Available | 0 |
| Label Efficient Regularization and Propagation for Graph Node Classification | Apr 19, 2022 | AttributeBenchmarking | —Unverified | 0 |
| Benchmarking Domain Generalization on EEG-based Emotion Recognition | Apr 18, 2022 | BenchmarkingDomain Adaptation | —Unverified | 0 |
| NICO++: Towards Better Benchmarking for Domain Generalization | Apr 17, 2022 | BenchmarkingDomain Generalization | CodeCode Available | 1 |
| Stress-Testing Point Cloud Registration on Automotive LiDAR | Apr 16, 2022 | Autonomous DrivingBenchmarking | CodeCode Available | 1 |
| Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks | Apr 16, 2022 | BenchmarkingInstruction Following | CodeCode Available | 3 |
| Deep learning model solves change point detection for multiple change types | Apr 15, 2022 | BenchmarkingChange Point Detection | CodeCode Available | 1 |
| SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos | Apr 14, 2022 | BenchmarkingMultiple Object Tracking | —Unverified | 0 |
| From Environmental Sound Representation to Robustness of 2D CNN Models Against Adversarial Attacks | Apr 14, 2022 | Adversarial AttackAdversarial Robustness | —Unverified | 0 |
| Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization | Apr 13, 2022 | BenchmarkingDeepFake Detection | CodeCode Available | 1 |
| Benchmarking Active Learning Strategies for Materials Optimization and Discovery | Apr 12, 2022 | Active LearningBenchmarking | —Unverified | 0 |
| EVOPS Benchmark: Evaluation of Plane Segmentation from RGBD and LiDAR Data | Apr 12, 2022 | BenchmarkingSegmentation | —Unverified | 0 |
| From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathology | Apr 11, 2022 | BenchmarkingCancer Classification | CodeCode Available | 0 |
| Data Splits and Metrics for Method Benchmarking on Surgical Action Triplet Datasets | Apr 11, 2022 | Action Triplet RecognitionBenchmarking | CodeCode Available | 1 |
| Metaethical Perspectives on 'Benchmarking' AI Ethics | Apr 11, 2022 | BenchmarkingEthics | —Unverified | 0 |
| Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model | Apr 9, 2022 | BenchmarkingLanguage Modeling | —Unverified | 0 |
| BioRED: A Rich Biomedical Relation Extraction Dataset | Apr 8, 2022 | BenchmarkingBinary Relation Extraction | CodeCode Available | 1 |
| Disability prediction in multiple sclerosis using performance outcome measures and demographic data | Apr 8, 2022 | BenchmarkingBIG-bench Machine Learning | —Unverified | 0 |
| tmVar 3.0: an improved variant concept recognition and normalization tool | Apr 7, 2022 | Benchmarking | —Unverified | 0 |
| Deep Visual Geo-localization Benchmark | Apr 7, 2022 | BenchmarkingData Augmentation | CodeCode Available | 2 |
| The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems | Apr 6, 2022 | AttributeBenchmarking | CodeCode Available | 1 |
| CLEAVE: Scalable and Edge-native Benchmarking of Networked Control Systems | Apr 5, 2022 | BenchmarkingEdge-computing | CodeCode Available | 0 |