On the Unknowable Limits to Prediction
2024-11-28Code Available0· sign in to hype
Jiani Yan, Charles Rahal
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/crahal/unpredictabilityOfficialIn papernone★ 0
Abstract
We propose a rigorous decomposition of predictive error, highlighting that not all 'irreducible' error is genuinely immutable. Many domains stand to benefit from iterative enhancements in measurement, construct validity, and modeling. Our approach demonstrates how apparently 'unpredictable' outcomes can become more tractable with improved data (across both target and features) and refined algorithms. By distinguishing aleatoric from epistemic error, we delineate how accuracy may asymptotically improve--though inherent stochasticity may remain--and offer a robust framework for advancing computational research.