SOTAVerified

Open Information Extraction

In natural language processing, open information extraction is the task of generating a structured, machine-readable representation of the information in text, usually in the form of triples or n-ary propositions (Source: Wikipedia).

Papers

Showing 1–50 of 207 papers

TitleStatusHype
Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph ConstructionCode2
UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity RecognitionCode2
AnnIE: An Annotation Platform for Constructing Complete Open Information Extraction BenchmarkCode1
DOM-LM: Learning Generalizable Representations for HTML DocumentsCode1
Open-CyKG: An Open Cyber Threat Intelligence Knowledge GraphCode1
BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction EvaluationCode1
Sequence-to-Sequence Models for Extracting Information from Registration and Legal DocumentsCode1
CompactIE: Compact Facts in Open Information ExtractionCode1
Zero-Shot Information Extraction as a Unified Text-to-Triple TranslationCode1
Context-NER : Contextual Phrase Generation at ScaleCode1
Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information ExtractionCode1
Linking Surface Facts to Large-Scale Knowledge GraphsCode1
IMoJIE: Iterative Memory-Based Joint Open Information ExtractionCode1
LSOIE: A Large-Scale Dataset for Supervised Open Information ExtractionCode1
Multi\^2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERTCode1
Multi^2OIE: Multilingual Open Information Extraction Based on Multi-Head Attention with BERTCode1
OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information ExtractionCode1
Refined Commonsense Knowledge from Large-Scale Web ContentsCode1
DeepStruct: Pretraining of Language Models for Structure PredictionCode1
Can We Predict New Facts with Open Knowledge Graph Embeddings? A Benchmark for Open Link PredictionCode1
DocOIE: A Document-level Context-Aware Dataset for OpenIECode1
DetIE: Multilingual Open Information Extraction Inspired by Object DetectionCode1
Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIsCode1
EVIDENCEMINER: Textual Evidence Discovery for Life Sciences—0
A Survey on Open Information Extraction—0
Analysing Errors of Open Information Extraction Systems—0
Exploiting Open IE for Deriving Multiple Premises Entailment Corpus—0
Chain Based RNN for Relation Classification—0
Challenges in Expanding Portuguese Resources: A View from Open Information Extraction—0
Automatic Open Knowledge Acquisition via Long Short-Term Memory Networks with Feedback Negative Sampling—0
CaRe: Open Knowledge Graph Embeddings—0
A Survey on Neural Open Information Extraction: Current Status and Future Directions—0
A Large-Scale Multilingual Disambiguation of Glosses—0
Embedding Open-domain Common-sense Knowledge from Text—0
Canonicalizing Open Knowledge Bases—0
Assertion-based QA with Question-Aware Open Information Extraction—0
Event Role Extraction using Domain-Relevant Word Representations—0
Explore Person Specific Evidence in Web Person Name Disambiguation—0
Building a Web-Scale Dependency-Parsed Corpus from CommonCrawl—0
Building a Knowledge Graph from Natural Language Definitions for Interpretable Text Entailment Recognition—0
A Predicate-Function-Argument Annotation of Natural Language for Open-Domain Information eXpression—0
Evaluation of Unsupervised Information Extraction—0
Dependency-Based Open Information Extraction—0
Bootstrapping for Numerical Open IE—0
Domain-Targeted, High Precision Knowledge Extraction—0
Bootstrapping Biomedical Ontologies for Scientific Text using NELL—0
ECNUICA at SemEval-2021 Task 11: Rule based Information Extraction Pipeline—0
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models—0
Aligning Open IE Relations and KB Relations using a Siamese Network Based on Word Embedding—0
Evaluating the Quality of a Knowledge Base Populated from Text—0
Show:102550
← PrevPage 1 of 5Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MacroIEF154.8—Unverified
2OpenIE 6 (CIGL-OIE)F154—Unverified
3IMoJIEF153.5—Unverified
4IMoJIEF153.3—Unverified
5OpenIE 6F152.7—Unverified
6OpenIE6F152.7—Unverified
7Multi2OIEF152.3—Unverified
8GPT-3.5-Turbo w/ Selected Demo & UncertaintyF152.1—Unverified
9OpenIE4F151.6—Unverified
10LLaMA-2-70B w/ Selected Demo & UncertaintyF151.5—Unverified
#ModelMetricClaimedVerifiedStatus
1CIGL-OIE + IGL-CA (OpenIE6)F140—Unverified
2CIGL-OIEF136.8—Unverified
3IMoJIEF136—Unverified
4MinIE Gashteovski et al. (2017)F135.8—Unverified
5OpenIE5F135.4—Unverified
6IGL-OIEF134.9—Unverified
7OpenIE4F134.4—Unverified
8ClausIE Del Corro and Gemulla (2013)F134.2—Unverified
9ClausIEF133.2—Unverified
10SpanOIEF131.9—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepEx (zero-shot)F172.6—Unverified
2DeepStruct multi-task w/ finetuneF171.3—Unverified
3Deepstruct multi-taskF171.2—Unverified
4SpanOIE [48]F169.4—Unverified
5SpanOIEF168.65—Unverified
6LLaMA-2-70B w/ Selected Demo & UncertaintyF165.8—Unverified
7GPT-3.5-Turbo w/ Selected Demo & UncertaintyF165.1—Unverified
8RnnOIE [36]F162—Unverified
9OpenIE4 [26]F160—Unverified
10ClausIE [9]F159—Unverified
#ModelMetricClaimedVerifiedStatus
1ClausIEPrecision0.5—Unverified
2MinIEPrecision0.43—Unverified
3CompactIEPrecision0.41—Unverified
4M2OIE (EN)Precision0.39—Unverified
5ROIE-TPrecision0.37—Unverified
6OpenIE6Precision0.31—Unverified
7M2OIE (ZH)Precision0.26—Unverified
8ROIE-NPrecision0.2—Unverified
9Stanford OIEPrecision0.11—Unverified
10M2OIE (DE)Precision0.09—Unverified
#ModelMetricClaimedVerifiedStatus
1SMiLe-OIEF151.73—Unverified
2BERT + Dep-GCN - Const-GCNF150.21—Unverified
3BERT + Dep-GCN [?] Const-GCNF149.89—Unverified
4BERT + Const-GCNF149.71—Unverified
5IMoJIE Kolluru et al. (2020)F149.24—Unverified
6BERT + Dep-GCNF148.71—Unverified
7BERT Solawetz and Larson (2021)F147.54—Unverified
8CIGL-OIE + IGL-CA Kolluru et al. (2020)F144.75—Unverified
9GloVe + bi-LSTM + CRFF144.48—Unverified
10GloVe + bi-LSTM Stanovsky et al. (2018)F143.9—Unverified
#ModelMetricClaimedVerifiedStatus
1DetIELSOIEF171.4—Unverified
2CIGL-OIEF159.7—Unverified
3DetIELSOIE + IGL-CAF158.7—Unverified
4DetIEIMoJIEF155.7—Unverified
5OpenIE4F154.6—Unverified
6OpenIE6 (CIGL-OIE + IGL-CA)F151.6—Unverified
7OpenIE5F149.5—Unverified
8DetIEIMoJIE (ours) + IGL-CAF145.9—Unverified
9OllIE Mausam et al. (2012)F136.8—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepEx (zero-shot)F185.5—Unverified
2DeepStruct multi-task w/ finetuneF145—Unverified
3DeepStruct multi-taskF143.6—Unverified
4Deepstruct zero-shotF128.9—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepStruct multi-task w/ finetuneF1451—Unverified
2DeepEx (zero-shot)F188.5—Unverified
3DeepStruct multi-taskF154.5—Unverified
4Deepstruct zero-shotF151—Unverified
#ModelMetricClaimedVerifiedStatus
1DeepEx (zero-shot)F191.2—Unverified
2DeepStruct multi-taskF150.8—Unverified
3DeepStruct multi-task w/ finetuneF149.1—Unverified
4Deepstruct zero-shotF143.8—Unverified
#ModelMetricClaimedVerifiedStatus
1DocIE w transformerF160.8—Unverified
2ReverbF155.8—Unverified
#ModelMetricClaimedVerifiedStatus
1DocIE w transformerF156.9—Unverified
2ReverbF149.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PENELOPIE Greek OIEF10.26—Unverified
#ModelMetricClaimedVerifiedStatus
1GEN2OIE (label-rescore)EN-F154.5—Unverified