SOTAVerified

Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation

2018-04-16NAACL 2018Unverified0· sign in to hype

Roman Grundkiewicz, Marcin Junczys-Dowmunt

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

We combine two of the most popular approaches to automated Grammatical Error Correction (GEC): GEC based on Statistical Machine Translation (SMT) and GEC based on Neural Machine Translation (NMT). The hybrid system achieves new state-of-the-art results on the CoNLL-2014 and JFLEG benchmarks. This GEC system preserves the accuracy of SMT output and, at the same time, generates more fluent sentences as it typical for NMT. Our analysis shows that the created systems are closer to reaching human-level performance than any other GEC system reported so far.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
CoNLL-2014 Shared TaskSMT + BiGRUF0.556.25Unverified
CoNLL-2014 Shared Task (10 annotations)SMT + BiGRUF0.572.04Unverified
JFLEGSMT + BiGRUGLEU61.5Unverified

Reproductions