The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of English Universal Dependency Parsers
2018-10-01CONLL 2018Unverified0· sign in to hype
Murhaf Fares, Stephan Oepen, Lilja {\O}vrelid, Jari Bj{\"o}rne, Richard Johansson
Unverified — Be the first to reproduce this paper.
ReproduceAbstract
We summarize empirical results and tentative conclusions from the Second Extrinsic Parser Evaluation Initiative (EPE 2018). We review the basic task setup, downstream applications involved, and end-to-end results for seventeen participating teams. Based on in-depth quantitative and qualitative analysis, we correlate intrinsic evaluation results at different layers of morph-syntactic analysis with observed downstream behavior.