CARLA longest6
longest6 is an evaluation benchmark for sensorimotor autonomous driving methods using the CARLA 0.9.10.1 simulator. It consists of 36 long routes in the publicly available Town 01-06 which, are populated with the maximum traffic density. The benchmark tests level 4 driving capabilities, methods are therefore allowed to train with data from the evaluation towns. Evaluation metrics follow the standard metrics from the CARLA leaderboard 1.0, except that stop sign infractions are not considered.
Papers
Showing 1–10 of 15 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DiffE2E | Driving Score | 83 | — | Unverified |
| 2 | TransFuser++ WP (TF++WP) | Driving Score | 73 | — | Unverified |
| 3 | DriveAdapter+TCP | Driving Score | 71 | — | Unverified |
| 4 | DriveGPT4-V2 | Driving Score | 70 | — | Unverified |
| 5 | EnDfuser + safety-rule | Driving Score | 70 | — | Unverified |
| 6 | TransFuser++ (TF++) | Driving Score | 69 | — | Unverified |
| 7 | ThinkTwice | Driving Score | 67 | — | Unverified |
| 8 | DriveAdapter | Driving Score | 59 | — | Unverified |
| 9 | Coaching a Teachable Student (CaT) | Driving Score | 58 | — | Unverified |
| 10 | Perception PlanT | Driving Score | 58 | — | Unverified |