Open Information Extraction
In natural language processing, open information extraction is the task of generating a structured, machine-readable representation of the information in text, usually in the form of triples or n-ary propositions (Source: Wikipedia).
Papers
Showing 1–25 of 207 papers
All datasetsCaRBWiRe57OIE2016BenchIELSOIE-wikiLSOIENYTPenn TreebankWebDocOIE-healthcareDocOIE-transportationCaRB OIE benchmark (Greek Use-case)
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MacroIE | F1 | 54.8 | — | Unverified |
| 2 | OpenIE 6 (CIGL-OIE) | F1 | 54 | — | Unverified |
| 3 | IMoJIE | F1 | 53.5 | — | Unverified |
| 4 | IMoJIE | F1 | 53.3 | — | Unverified |
| 5 | OpenIE 6 | F1 | 52.7 | — | Unverified |
| 6 | OpenIE6 | F1 | 52.7 | — | Unverified |
| 7 | Multi2OIE | F1 | 52.3 | — | Unverified |
| 8 | GPT-3.5-Turbo w/ Selected Demo & Uncertainty | F1 | 52.1 | — | Unverified |
| 9 | OpenIE4 | F1 | 51.6 | — | Unverified |
| 10 | LLaMA-2-70B w/ Selected Demo & Uncertainty | F1 | 51.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CIGL-OIE + IGL-CA (OpenIE6) | F1 | 40 | — | Unverified |
| 2 | CIGL-OIE | F1 | 36.8 | — | Unverified |
| 3 | IMoJIE | F1 | 36 | — | Unverified |
| 4 | MinIE Gashteovski et al. (2017) | F1 | 35.8 | — | Unverified |
| 5 | OpenIE5 | F1 | 35.4 | — | Unverified |
| 6 | IGL-OIE | F1 | 34.9 | — | Unverified |
| 7 | OpenIE4 | F1 | 34.4 | — | Unverified |
| 8 | ClausIE Del Corro and Gemulla (2013) | F1 | 34.2 | — | Unverified |
| 9 | ClausIE | F1 | 33.2 | — | Unverified |
| 10 | SpanOIE | F1 | 31.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DeepEx (zero-shot) | F1 | 72.6 | — | Unverified |
| 2 | DeepStruct multi-task w/ finetune | F1 | 71.3 | — | Unverified |
| 3 | Deepstruct multi-task | F1 | 71.2 | — | Unverified |
| 4 | SpanOIE [48] | F1 | 69.4 | — | Unverified |
| 5 | SpanOIE | F1 | 68.65 | — | Unverified |
| 6 | LLaMA-2-70B w/ Selected Demo & Uncertainty | F1 | 65.8 | — | Unverified |
| 7 | GPT-3.5-Turbo w/ Selected Demo & Uncertainty | F1 | 65.1 | — | Unverified |
| 8 | RnnOIE [36] | F1 | 62 | — | Unverified |
| 9 | OpenIE4 [26] | F1 | 60 | — | Unverified |
| 10 | ClausIE [9] | F1 | 59 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ClausIE | Precision | 0.5 | — | Unverified |
| 2 | MinIE | Precision | 0.43 | — | Unverified |
| 3 | CompactIE | Precision | 0.41 | — | Unverified |
| 4 | M2OIE (EN) | Precision | 0.39 | — | Unverified |
| 5 | ROIE-T | Precision | 0.37 | — | Unverified |
| 6 | OpenIE6 | Precision | 0.31 | — | Unverified |
| 7 | M2OIE (ZH) | Precision | 0.26 | — | Unverified |
| 8 | ROIE-N | Precision | 0.2 | — | Unverified |
| 9 | Stanford OIE | Precision | 0.11 | — | Unverified |
| 10 | M2OIE (DE) | Precision | 0.09 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SMiLe-OIE | F1 | 51.73 | — | Unverified |
| 2 | BERT + Dep-GCN - Const-GCN | F1 | 50.21 | — | Unverified |
| 3 | BERT + Dep-GCN [?] Const-GCN | F1 | 49.89 | — | Unverified |
| 4 | BERT + Const-GCN | F1 | 49.71 | — | Unverified |
| 5 | IMoJIE Kolluru et al. (2020) | F1 | 49.24 | — | Unverified |
| 6 | BERT + Dep-GCN | F1 | 48.71 | — | Unverified |
| 7 | BERT Solawetz and Larson (2021) | F1 | 47.54 | — | Unverified |
| 8 | CIGL-OIE + IGL-CA Kolluru et al. (2020) | F1 | 44.75 | — | Unverified |
| 9 | GloVe + bi-LSTM + CRF | F1 | 44.48 | — | Unverified |
| 10 | GloVe + bi-LSTM Stanovsky et al. (2018) | F1 | 43.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DetIELSOIE | F1 | 71.4 | — | Unverified |
| 2 | CIGL-OIE | F1 | 59.7 | — | Unverified |
| 3 | DetIELSOIE + IGL-CA | F1 | 58.7 | — | Unverified |
| 4 | DetIEIMoJIE | F1 | 55.7 | — | Unverified |
| 5 | OpenIE4 | F1 | 54.6 | — | Unverified |
| 6 | OpenIE6 (CIGL-OIE + IGL-CA) | F1 | 51.6 | — | Unverified |
| 7 | OpenIE5 | F1 | 49.5 | — | Unverified |
| 8 | DetIEIMoJIE (ours) + IGL-CA | F1 | 45.9 | — | Unverified |
| 9 | OllIE Mausam et al. (2012) | F1 | 36.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DeepEx (zero-shot) | F1 | 85.5 | — | Unverified |
| 2 | DeepStruct multi-task w/ finetune | F1 | 45 | — | Unverified |
| 3 | DeepStruct multi-task | F1 | 43.6 | — | Unverified |
| 4 | Deepstruct zero-shot | F1 | 28.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DeepStruct multi-task w/ finetune | F1 | 451 | — | Unverified |
| 2 | DeepEx (zero-shot) | F1 | 88.5 | — | Unverified |
| 3 | DeepStruct multi-task | F1 | 54.5 | — | Unverified |
| 4 | Deepstruct zero-shot | F1 | 51 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DeepEx (zero-shot) | F1 | 91.2 | — | Unverified |
| 2 | DeepStruct multi-task | F1 | 50.8 | — | Unverified |
| 3 | DeepStruct multi-task w/ finetune | F1 | 49.1 | — | Unverified |
| 4 | Deepstruct zero-shot | F1 | 43.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DocIE w transformer | F1 | 60.8 | — | Unverified |
| 2 | Reverb | F1 | 55.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | DocIE w transformer | F1 | 56.9 | — | Unverified |
| 2 | Reverb | F1 | 49.7 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | PENELOPIE Greek OIE | F1 | 0.26 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | GEN2OIE (label-rescore) | EN-F1 | 54.5 | — | Unverified |