SOTAVerified

SpEL: Structured Prediction for Entity Linking

2023-10-23Code Available1· sign in to hype

Hassan S. Shavarani, Anoop Sarkar

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Entity linking is a prominent thread of research focused on structured data creation by linking spans of text to an ontology or knowledge source. We revisit the use of structured prediction for entity linking which classifies each individual input token as an entity, and aggregates the token predictions. Our system, called SpEL (Structured prediction for Entity Linking) is a state-of-the-art entity linking system that uses some new ideas to apply structured prediction to the task of entity linking including: two refined fine-tuning steps; a context sensitive prediction aggregation strategy; reduction of the size of the model's output vocabulary, and; we address a common problem in entity-linking systems where there is a training vs. inference tokenization mismatch. Our experiments show that we can outperform the state-of-the-art on the commonly used AIDA benchmark dataset for entity linking to Wikipedia. Our method is also very compute efficient in terms of number of parameters and speed of inference.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
AIDA-CoNLLSpEL-large (2023)Micro-F1 strong88.6Unverified
AIDA-CoNLLSpEL-base (2023)Micro-F1 strong88.1Unverified
AIDA/testcSpEL-large (2023)Micro-F1 strong77.5Unverified
AIDA/testcSpEL-base (2023)Micro-F1 strong73.7Unverified

Reproductions