Key Information Extraction
Key Information Extraction (KIE) is aimed at extracting structured information (e.g. key-value pairs) from form-style documents (e.g. invoices), which makes an important step towards intelligent document understanding.
Papers
No papers found.
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | RORE (GeoLayoutLM) | F1 | 98.52 | — | Unverified |
| 2 | GeoLayoutLM | F1 | 97.97 | — | Unverified |
| 3 | LayoutLMv3 Large | F1 | 97.46 | — | Unverified |
| 4 | LayoutMask (large) | F1 | 97.19 | — | Unverified |
| 5 | LayoutMask (base) | F1 | 96.99 | — | Unverified |
| 6 | TPP (LayoutMask) | F1 | 96.92 | — | Unverified |
| 7 | LILT | F1 | 96.07 | — | Unverified |
| 8 | LayoutLMv2LARGE | F1 | 96.01 | — | Unverified |
| 9 | LayoutLMv2BASE | F1 | 94.95 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | LayoutLMv2LARGE (Excluding OCR mismatch) | F1 | 97.81 | — | Unverified |
| 2 | RORE (GeoLayoutLM) | F1 | 96.97 | — | Unverified |
| 3 | LayoutLMv2LARGE | F1 | 96.61 | — | Unverified |
| 4 | LayoutLMv2BASE | F1 | 96.25 | — | Unverified |
| 5 | ChatGPT 3.5 SpatialFormat | Accuracy | 77 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | LayoutLMv2LARGE | F1 | 85.2 | — | Unverified |
| 2 | LayoutLMv2BASE | F1 | 83.3 | — | Unverified |
| 3 | LAMBERT (75M) | F1 | 80.42 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DAN | F1 (%) | 95.05 | — | Unverified |