Prospects for inconsistency detection using large language models and sheaves

Code

• github.com/stevehuntsman/prospectsforinconsistencydetection
  OfficialIn papernone★ 3

Abstract

We demonstrate that large language models can produce reasonable numerical ratings of the logical consistency of claims. We also outline a mathematical approach based on sheaf theory for lifting such ratings to hypertexts such as laws, jurisprudence, and social media and evaluating their consistency globally. This approach is a promising avenue to increasing consistency in and of government, as well as to combating mis- and disinformation and related ills.

Tasks

Reproductions