SOTAVerified

Improving Entity Disambiguation by Reasoning over a Knowledge Base

2022-07-08NAACL 2022Code Available2· sign in to hype

Tom Ayoola, Joseph Fisher, Andrea Pierleoni

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Recent work in entity disambiguation (ED) has typically neglected structured knowledge base (KB) facts, and instead relied on a limited subset of KB information, such as entity descriptions or types. This limits the range of contexts in which entities can be disambiguated. To allow the use of all KB facts, as well as descriptions and types, we introduce an ED model which links entities by reasoning over a symbolic knowledge base in a fully differentiable fashion. Our model surpasses state-of-the-art baselines on six well-established ED datasets by 1.3 F1 on average. By allowing access to all KB information, our model is less reliant on popularity-based entity priors, and improves performance on the challenging ShadowLink dataset (which emphasises infrequent and ambiguous entities) by 12.7 F1.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
ACE2004KBEDMicro-F193.4Unverified
AIDA-CoNLLKBEDIn-KB Accuracy90.4Unverified
AQUAINTKBEDMicro-F192.6Unverified
MSNBCKBEDMicro-F194.8Unverified
ShadowLink-ShadowKBEDMicro-F147.6Unverified
ShadowLink-TopKBEDMicro-F164.2Unverified
WNED-CWEBKBEDMicro-F178.2Unverified
WNED-WIKIKBEDMicro-F190.4Unverified

Reproductions