SOTAVerified

CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains

2022-06-16Code Available1· sign in to hype

Julian Gebele, Bonifaz Stuhr, Johann Haselberger

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Unsupervised Domain Adaptation demonstrates great potential to mitigate domain shifts by transferring models from labeled source domains to unlabeled target domains. While Unsupervised Domain Adaptation has been applied to a wide variety of complex vision tasks, only few works focus on lane detection for autonomous driving. This can be attributed to the lack of publicly available datasets. To facilitate research in these directions, we propose CARLANE, a 3-way sim-to-real domain adaptation benchmark for 2D lane detection. CARLANE encompasses the single-target datasets MoLane and TuLane and the multi-target dataset MuLane. These datasets are built from three different domains, which cover diverse scenes and contain a total of 163K unique images, 118K of which are annotated. In addition we evaluate and report systematic baselines, including our own method, which builds upon Prototypical Cross-domain Self-supervised Learning. We find that false positive and false negative rates of the evaluated domain adaptation methods are high compared to those of fully supervised baselines. This affirms the need for benchmarks such as CARLANE to further strengthen research in Unsupervised Domain Adaptation for lane detection. CARLANE, all evaluated models and the corresponding implementations are publicly available at https://carlanebenchmark.github.io.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
MoLaneUFLD-DANN-ResNet18Lane Accuracy (LA)87.65Unverified
MoLaneUFLD-DANN-ResNet32Lane Accuracy (LA)90.91Unverified
MoLaneUFLD-ADDA-ResNet32Lane Accuracy (LA)92.39Unverified
MoLaneUFLD-ADDA-ResNet18Lane Accuracy (LA)92.85Unverified
MoLaneUFLD-SGADA-ResNet32Lane Accuracy (LA)93.31Unverified
MoLaneUFLD-SGPCS-ResNet32Lane Accuracy (LA)93.53Unverified
MoLaneUFLD-SGADA-ResNet18Lane Accuracy (LA)93.82Unverified
MoLaneUFLD-SGPCS-ResNet18Lane Accuracy (LA)93.94Unverified
MuLaneUFLD-SGADA-ResNet32Lane Accuracy (LA)91.63Unverified
MuLaneUFLD-SGPCS-ResNet18Lane Accuracy (LA)91.57Unverified
MuLaneUFLD-SGPCS-ResNet32Lane Accuracy (LA)91.55Unverified
MuLaneUFLD-SGADA-ResNet18Lane Accuracy (LA)90.71Unverified
MuLaneUFLD-ADDA-ResNet32Lane Accuracy (LA)90.22Unverified
MuLaneUFLD-ADDA-ResNet18Lane Accuracy (LA)89.83Unverified
MuLaneUFLD-DANN-ResNet32Lane Accuracy (LA)88.76Unverified
MuLaneUFLD-DANN-ResNet18Lane Accuracy (LA)86.01Unverified
TuLaneUFLD-DANN-ResNet18Lane Accuracy (LA)88.74Unverified
TuLaneUFLD-ADDA-ResNet18Lane Accuracy (LA)90.72Unverified
TuLaneUFLD-DANN-ResNet32Lane Accuracy (LA)91.06Unverified
TuLaneUFLD-ADDA-ResNet32Lane Accuracy (LA)91.39Unverified
TuLaneUFLD-SGPCS-ResNet18Lane Accuracy (LA)91.55Unverified
TuLaneUFLD-SGADA-ResNet18Lane Accuracy (LA)91.7Unverified
TuLaneUFLD-SGADA-ResNet32Lane Accuracy (LA)92.04Unverified
TuLaneUFLD-SGPCS-ResNet32Lane Accuracy (LA)93.29Unverified

Reproductions