SOTAVerified

Leveraging Synthetic Data in Object Detection on Unmanned Aerial Vehicles

2021-12-22Code Available1· sign in to hype

Benjamin Kiefer, David Ott, Andreas Zell

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Acquiring data to train deep learning-based object detectors on Unmanned Aerial Vehicles (UAVs) is expensive, time-consuming and may even be prohibited by law in specific environments. On the other hand, synthetic data is fast and cheap to access. In this work, we explore the potential use of synthetic data in object detection from UAVs across various application environments. For that, we extend the open-source framework DeepGTAV to work for UAV scenarios. We capture various large-scale high-resolution synthetic data sets in several domains to demonstrate their use in real-world object detection from UAVs by analyzing multiple training strategies across several models. Furthermore, we analyze several different data generation and sampling parameters to provide actionable engineering advice for further scientific research. The DeepGTAV framework is available at https://git.io/Jyf5j.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
SeaDronesSeeSynth Pretrained Faster R-CNN ResNeXt-101-FPNmAP@0.559.2Unverified
SeaDronesSeeSynth Pretrained Yolo5mAP@0.559.08Unverified
SeaDronesSeeSynth Pretrained EffDetD0mAP@0.538.74Unverified
SeaDronesSeeYolo 5mAP@0.5054.74Unverified

Reproductions