SOTAVerified

Utilising Deep Learning to Elicit Expert Uncertainty

2025-01-21Code Available0· sign in to hype

Julia R. Falconer, Eibe Frank, Devon L. L. Polaschek, Chaitanya Joshi

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Recent work [ 14 ] has introduced a method for prior elicitation that utilizes records of expert decisions to infer a prior distribution. While this method provides a promising approach to eliciting expert uncertainty, it has only been demonstrated using tabular data, which may not entirely represent the information used by experts to make decisions. In this paper, we demonstrate how analysts can adopt a deep learning approach to utilize the method proposed in [14 ] with the actual information experts use. We provide an overview of deep learning models that can effectively model expert decision-making to elicit distributions that capture expert uncertainty and present an example examining the risk of colon cancer to show in detail how these models can be used.

Tasks

Reproductions