SOTAVerified

OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction

2020-10-07EMNLP 2020Code Available1· sign in to hype

Keshav Kolluru, Vaibhav Adlakha, Samarth Aggarwal, Mausam, Soumen Chakrabarti

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

A recent state-of-the-art neural open information extraction (OpenIE) system generates extractions iteratively, requiring repeated encoding of partial outputs. This comes at a significant computational cost. On the other hand, sequence labeling approaches for OpenIE are much faster, but worse in extraction quality. In this paper, we bridge this trade-off by presenting an iterative labeling-based system that establishes a new state of the art for OpenIE, while extracting 10x faster. This is achieved through a novel Iterative Grid Labeling (IGL) architecture, which treats OpenIE as a 2-D grid labeling task. We improve its performance further by applying coverage (soft) constraints on the grid at training time. Moreover, on observing that the best OpenIE systems falter at handling coordination structures, our OpenIE system also incorporates a new coordination analyzer built with the same IGL architecture. This IGL based coordination analyzer helps our OpenIE system handle complicated coordination structures, while also establishing a new state of the art on the task of coordination analysis, with a 12.3 pts improvement in F1 over previous analyzers. Our OpenIE system, OpenIE6, beats the previous systems by as much as 4 pts in F1, while being much faster.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CaRBOpenIE 6 (CIGL-OIE)F154Unverified
CaRBOpenIE 6F152.7Unverified
CaRBSpanOIEF148.5Unverified
CaRBOpenIE5F148Unverified
CaRBClausIEF145Unverified
CaRBMinIEF141.9Unverified
CaRBSenseOIEF128.2Unverified
WiRe57CIGL-OIE + IGL-CA (OpenIE6)F140Unverified
WiRe57CIGL-OIEF136.8Unverified
WiRe57IMoJIEF136Unverified
WiRe57OpenIE5F135.4Unverified
WiRe57IGL-OIEF134.9Unverified
WiRe57OpenIE4F134.4Unverified
WiRe57ClausIEF133.2Unverified
WiRe57SpanOIEF131.9Unverified
WiRe57MinIEF128.5Unverified
WiRe57RnnOIEF126.4Unverified
WiRe57SenseOIEF110.7Unverified

Reproductions