SOTAVerified

Key Information Extraction

Key Information Extraction (KIE) is aimed at extracting structured information (e.g. key-value pairs) from form-style documents (e.g. invoices), which makes an important step towards intelligent document understanding.

Papers

Showing 125 of 74 papers

TitleStatusHype
TextMonkey: An OCR-Free Large Multimodal Model for Understanding DocumentCode5
A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document UnderstandingCode2
OCRBench: On the Hidden Mystery of OCR in Large Multimodal ModelsCode2
LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document UnderstandingCode2
LayoutLM: Pre-training of Text and Layout for Document Image UnderstandingCode2
Modeling Layout Reading Order as Ordering Relations for Visually-rich Document UnderstandingCode1
KVP10k : A Comprehensive Dataset for Key-Value Pair Extraction in Business DocumentsCode1
PEneo: Unifying Line Extraction, Line Grouping, and Entity Linking for End-to-end Document Pair ExtractionCode1
Exploring OCR Capabilities of GPT-4V(ision) : A Quantitative and In-depth EvaluationCode1
GenKIE: Robust Generative Multimodal Document Key Information ExtractionCode1
Reading Order Matters: Information Extraction from Visually-rich Documents by Token Path PredictionCode1
Form-NLU: Dataset for the Form Natural Language UnderstandingCode1
DocILE Benchmark for Document Information Localization and ExtractionCode1
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document UnderstandingCode1
Doc2Graph: a Task Agnostic Document Understanding Framework based on Graph Neural NetworksCode1
BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from DocumentsCode1
Key Information Extraction From Documents: Evaluation And GeneratorCode1
PICK: Processing Key Information Extraction from Documents using Improved Graph Learning-Convolutional NetworksCode1
LAMBERT: Layout-Aware (Language) Modeling for information extractionCode1
PaddleOCR 3.0 Technical ReportCode0
Class-Agnostic Region-of-Interest Matching in Document ImagesCode0
Hallucinations and Key Information Extraction in Medical Texts: A Comprehensive Assessment of Open-Source Large Language Models0
Emergency Communication: OTFS-Based Semantic Transmission with Diffusion Noise Suppression0
KIEval: Evaluation Metric for Document Key Information Extraction0
OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language ModelsCode0
Show:102550
← PrevPage 1 of 3Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1RORE (GeoLayoutLM)F198.52Unverified
2GeoLayoutLMF197.97Unverified
3LayoutLMv3 LargeF197.46Unverified
4LayoutMask (large)F197.19Unverified
5LayoutMask (base)F196.99Unverified
6TPP (LayoutMask)F196.92Unverified
7LILTF196.07Unverified
8LayoutLMv2LARGEF196.01Unverified
9LayoutLMv2BASEF194.95Unverified
#ModelMetricClaimedVerifiedStatus
1LayoutLMv2LARGE (Excluding OCR mismatch)F197.81Unverified
2RORE (GeoLayoutLM)F196.97Unverified
3LayoutLMv2LARGEF196.61Unverified
4LayoutLMv2BASEF196.25Unverified
5ChatGPT 3.5 SpatialFormatAccuracy77Unverified
#ModelMetricClaimedVerifiedStatus
1LayoutLMv2LARGEF185.2Unverified
2LayoutLMv2BASEF183.3Unverified
3LAMBERT (75M)F180.42Unverified
#ModelMetricClaimedVerifiedStatus
1DANF1 (%)95.05Unverified