SOTAVerified

Entity Typing

Entity Typing is an important task in text analysis. Assigning types (e.g., person, location, organization) to mentions of entities in documents enables effective structured analysis of unstructured text corpora. The extracted type information can be used in a wide range of ways (e.g., serving as primitives for information extraction and knowledge base (KB) completion, and assisting question answering). Traditional Entity Typing systems focus on a small set of coarse types (typically fewer than 10). Recent studies work on a much larger set of fine-grained types which form a tree-structured hierarchy (e.g., actor as a subtype of artist, and artist is a subtype of person).

Source: Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding

Image Credit: Label Noise Reduction in Entity Typing by Heterogeneous Partial-Label Embedding

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MLMETF178.2—Unverified
2K-Adapter ( fac-adapter )F177.69—Unverified
3K-Adapter ( fac-adapter + lin-adapter )F177.61—Unverified
4ERNIEF175.56—Unverified
5MCCE-B (replicated by Adaseq)F152.1—Unverified
6Prompt + NPCRF (replicated by Adaseq)F150.1—Unverified
7UniST-LargeF149.9—Unverified
8Prompt Learning (replicated by Adaseq))F149.3—Unverified
9MLMETF149.1—Unverified
10RoBERTa-Large + NPCRF (replicated by Adaseq)F147.3—Unverified
#ModelMetricClaimedVerifiedStatus
1MLMETF149.1—Unverified
2ELMo (distant denoising data)F140.2—Unverified
3LabelGCN Xiong et al. (2019)F136.9—Unverified
4Choi et al. (2018) w augmentationF132—Unverified
#ModelMetricClaimedVerifiedStatus
1REXELAvg F196.01—Unverified
2REXELAvg F190.93—Unverified
3REXELAvg F186.74—Unverified
#ModelMetricClaimedVerifiedStatus
1ReFinEDMicro-F184—Unverified
#ModelMetricClaimedVerifiedStatus
1LITEMacro F180.1—Unverified
#ModelMetricClaimedVerifiedStatus
1TextEnt-fullAccuracy37.4—Unverified
#ModelMetricClaimedVerifiedStatus
1LITEMacro F186.6—Unverified