SOTAVerified

CARLA longest6

longest6 is an evaluation benchmark for sensorimotor autonomous driving methods using the CARLA 0.9.10.1 simulator. It consists of 36 long routes in the publicly available Town 01-06 which, are populated with the maximum traffic density. The benchmark tests level 4 driving capabilities, methods are therefore allowed to train with data from the evaluation towns. Evaluation metrics follow the standard metrics from the CARLA leaderboard 1.0, except that stop sign infractions are not considered.

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DiffE2EDriving Score83—Unverified
2TransFuser++ WP (TF++WP)Driving Score73—Unverified
3DriveAdapter+TCPDriving Score71—Unverified
4DriveGPT4-V2Driving Score70—Unverified
5EnDfuser + safety-ruleDriving Score70—Unverified
6TransFuser++ (TF++)Driving Score69—Unverified
7ThinkTwiceDriving Score67—Unverified
8DriveAdapterDriving Score59—Unverified
9Coaching a Teachable Student (CaT)Driving Score58—Unverified
10Perception PlanTDriving Score58—Unverified