SOTAVerified

CARLA longest6

longest6 is an evaluation benchmark for sensorimotor autonomous driving methods using the CARLA 0.9.10.1 simulator. It consists of 36 long routes in the publicly available Town 01-06 which, are populated with the maximum traffic density. The benchmark tests level 4 driving capabilities, methods are therefore allowed to train with data from the evaluation towns. Evaluation metrics follow the standard metrics from the CARLA leaderboard 1.0, except that stop sign infractions are not considered.

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1DiffE2EDriving Score83Unverified
2TransFuser++ WP (TF++WP)Driving Score73Unverified
3DriveAdapter+TCPDriving Score71Unverified
4DriveGPT4-V2Driving Score70Unverified
5EnDfuser + safety-ruleDriving Score70Unverified
6TransFuser++ (TF++)Driving Score69Unverified
7ThinkTwiceDriving Score67Unverified
8DriveAdapterDriving Score59Unverified
9Coaching a Teachable Student (CaT)Driving Score58Unverified
10Perception PlanTDriving Score58Unverified