SMAC
Bechmarks for Efficient Exploration of Completion of Multi-stage Tasks and Usage of Environmental Factors
Papers
Showing 1–10 of 121 papers
All datasetsSMAC MMM2SMAC 3s5z_vs_3s6zSMAC corridorSMAC 6h_vs_8zSMAC 27m_vs_30mSMAC 26m_vs_30mSMAC 3s5z_vs_4s6zSMAC 6h_vs_9zSMAC corridor_2z_vs_24zgSMAC MMM2_7m2M1M_vs_8m4M1MSMAC MMM2_7m2M1M_vs_9m3M1M
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ACE | Median Win Rate | 100 | — | Unverified |
| 2 | DDN | Median Win Rate | 97.22 | — | Unverified |
| 3 | QPLEX | Median Win Rate | 96.88 | — | Unverified |
| 4 | DPLEX | Median Win Rate | 96.88 | — | Unverified |
| 5 | DMIX | Median Win Rate | 95.11 | — | Unverified |
| 6 | QMIX | Median Win Rate | 92.44 | — | Unverified |
| 7 | VDN | Median Win Rate | 89.2 | — | Unverified |
| 8 | DIQL | Median Win Rate | 85.23 | — | Unverified |
| 9 | QMIX | Median Win Rate | 69 | — | Unverified |
| 10 | QMIX | Median Win Rate | 69 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ACE | Median Win Rate | 100 | — | Unverified |
| 2 | DDN | Median Win Rate | 94.03 | — | Unverified |
| 3 | DMIX | Median Win Rate | 91.08 | — | Unverified |
| 4 | DPLEX | Median Win Rate | 90.62 | — | Unverified |
| 5 | VDN | Median Win Rate | 89.2 | — | Unverified |
| 6 | QPLEX | Median Win Rate | 84.38 | — | Unverified |
| 7 | QMIX | Median Win Rate | 67.22 | — | Unverified |
| 8 | DIQL | Median Win Rate | 62.22 | — | Unverified |
| 9 | IQL | Median Win Rate | 29.83 | — | Unverified |
| 10 | VDN | Median Win Rate | 2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ACE | Median Win Rate | 100 | — | Unverified |
| 2 | DDN | Median Win Rate | 95.4 | — | Unverified |
| 3 | DIQL | Median Win Rate | 91.62 | — | Unverified |
| 4 | DMIX | Median Win Rate | 90.45 | — | Unverified |
| 5 | VDN | Median Win Rate | 85.34 | — | Unverified |
| 6 | IQL | Median Win Rate | 84.87 | — | Unverified |
| 7 | DPLEX | Median Win Rate | 81.25 | — | Unverified |
| 8 | QPLEX | Median Win Rate | 75 | — | Unverified |
| 9 | QMIX | Median Win Rate | 37.61 | — | Unverified |
| 10 | QMIX | Median Win Rate | 1 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ACE | Median Win Rate | 93.75 | — | Unverified |
| 2 | DDN | Median Win Rate | 83.92 | — | Unverified |
| 3 | DMIX | Median Win Rate | 49.43 | — | Unverified |
| 4 | DPLEX | Median Win Rate | 43.75 | — | Unverified |
| 5 | QPLEX | Average Score | 15.95 | — | Unverified |
| 6 | QMIX | Median Win Rate | 12.78 | — | Unverified |
| 7 | QMIX | Median Win Rate | 3 | — | Unverified |
| 8 | QMIX | Median Win Rate | 3 | — | Unverified |
| 9 | DIQL | Median Win Rate | 0 | — | Unverified |
| 10 | IQL | Median Win Rate | 0 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DDN | Median Win Rate | 91.48 | — | Unverified |
| 2 | DPLEX | Median Win Rate | 90.62 | — | Unverified |
| 3 | DMIX | Median Win Rate | 85.45 | — | Unverified |
| 4 | QMIX | Median Win Rate | 84.77 | — | Unverified |
| 5 | QPLEX | Median Win Rate | 78.12 | — | Unverified |
| 6 | VDN | Median Win Rate | 63.12 | — | Unverified |
| 7 | QMIX | Median Win Rate | 49 | — | Unverified |
| 8 | QMIX | Median Win Rate | 49 | — | Unverified |
| 9 | DIQL | Median Win Rate | 6.02 | — | Unverified |
| 10 | IQL | Median Win Rate | 2.27 | — | Unverified |