Semantic entity labeling
- One of Form Understanding task (Word grouping, Semantic entity labeling, Entity linking)
- Classifying entities into one of four pre-defined categories: question, answer, header and, other.
cited from
G. Jaume, H. K. Ekenel, J. Thiran "FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents," 2019
Papers
Showing 11–14 of 14 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | LayoutMask (large) | F1 | 93.2 | — | Unverified |
| 2 | ERNIE-Layoutlarge | F1 | 93.12 | — | Unverified |
| 3 | LayoutMask (base) | F1 | 92.91 | — | Unverified |
| 4 | GeoLayoutLM | F1 | 92.86 | — | Unverified |
| 5 | LayoutLMv3 Large | F1 | 92.08 | — | Unverified |
| 6 | RORE (GeoLayoutLM) | F1 | 91.84 | — | Unverified |
| 7 | StrucTexTv2 (large) | F1 | 91.82 | — | Unverified |
| 8 | XDoc1M | F1 | 89.4 | — | Unverified |
| 9 | StrucTexTv2 (small) | F1 | 89.23 | — | Unverified |
| 10 | RORE (GeoLayoutLM) | F1 | 88.46 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | RORE (LayoutLMv3-large) | F1 | 84.53 | — | Unverified |
| 2 | LayoutLMv3 (large) | F1 | 83.88 | — | Unverified |
| 3 | LayoutLMv3 (large) | F1 | 83.88 | — | Unverified |
| 4 | RORE (LayoutLMv3-base) | F1 | 82.8 | — | Unverified |
| 5 | LayoutLMv3 (base) | F1 | 82.3 | — | Unverified |
| 6 | LayoutLMv3 (base) | F1 | 82.3 | — | Unverified |
| 7 | LayoutLMv3 (large) | F1 | 78.14 | — | Unverified |
| 8 | LayoutLMv3 (large) | F1 | 78.14 | — | Unverified |
| 9 | LayoutLMv3 (base) | F1 | 67.47 | — | Unverified |
| 10 | LayoutLMv3 (base) | F1 | 67.47 | — | Unverified |