SOTAVerified

Energy Efficiency Considerations for Popular AI Benchmarks

2023-04-17Code Available0· sign in to hype

Raphael Fischer, Matthias Jakobs, Katharina Morik

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Advances in artificial intelligence need to become more resource-aware and sustainable. This requires clear assessment and reporting of energy efficiency trade-offs, like sacrificing fast running time for higher predictive performance. While first methods for investigating efficiency have been proposed, we still lack comprehensive results for popular methods and data sets. In this work, we attempt to fill this information gap by providing empiric insights for popular AI benchmarks, with a total of 100 experiments. Our findings are evidence of how different data sets all have their own efficiency landscape, and show that methods can be more or less likely to act efficiently.

Reproductions