SOTAVerified

Multispectral Object Detection

Only using RGB cameras for automatic outdoor scene analysis is challenging when, for example, facing insufficient illumination or adverse weather. To improve the recognition reliability, multispectral systems add additional cameras (e.g. infra-red) and perform object detection from multispectral data. Although multispectral scene analysis with deep learning has be shown to have a great potential, there are still many open research questions and it has not been widely deployed in industrial contexts.

Papers

Showing 31–39 of 39 papers

TitleStatusHype
CAFF-DINO: Multi-spectral object detection transformers with cross-attention features fusion—0
Surveying You Only Look Once (YOLO) Multispectral Object Detection Advancements, Applications And Challenges—0
A Comparison of Deep Saliency Map Generators on Multispectral Data in Object Detection—0
A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)—0
Multimodal Object Detection by Channel Switching and Spatial Attention—0
Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detection—0
Multispectral Object Detection with Deep Learning—0
Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarks—0
Fusion of Multispectral Data Through Illumination-aware Deep Neural Networks for Pedestrian Detection—0
Show:102550
← PrevPage 4 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MMPedestronmAP5086.4—Unverified
2RGB-X Scene Adaptive CBAMmAP5086.16—Unverified
3CAFF-DINOmAP5085.5—Unverified
4RSDetmAP5083.9—Unverified
5CMXmAP5082.2—Unverified
6UniRGB-IRmAP5081.4—Unverified
7MiPamAP5081.3—Unverified
8CSSAmAP5079.2—Unverified
9CFTmAP5077.7—Unverified
10ProbEnmAP5075.5—Unverified
#ModelMetricClaimedVerifiedStatus
1FusionRPN+BFAll Miss Rate51.7—Unverified
2Halfway FusionAll Miss Rate49.18—Unverified
3IATDNN+IASSAll Miss Rate48.96—Unverified
4IAFR-CNNAll Miss Rate44.23—Unverified
5CIANAll Miss Rate35.53—Unverified
6AR-CNNAll Miss Rate34.95—Unverified
7MSDS-R-CNNAll Miss Rate34.15—Unverified
8MBNetAll Miss Rate31.87—Unverified
9TSFADetAll Miss Rate30.74—Unverified
10CMPDAll Miss Rate28.98—Unverified
#ModelMetricClaimedVerifiedStatus
1YOLOv3-4‐channel[email protected]:0.9564.4—Unverified
2YOLOv3-Ensemble[email protected]:0.9553.4—Unverified
#ModelMetricClaimedVerifiedStatus
1CFTmAP5097.5—Unverified