SOTAVerified

Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction

2022-03-19ACL 2022Code Available1· sign in to hype

Zhanming Jie, Jierui Li, Wei Lu

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Solving math word problems requires deductive reasoning over the quantities in the text. Various recent research efforts mostly relied on sequence-to-sequence or sequence-to-tree models to generate mathematical expressions without explicitly performing relational reasoning between quantities in the given context. While empirically effective, such approaches typically do not provide explanations for the generated expressions. In this work, we view the task as a complex relation extraction problem, proposing a novel approach that presents explainable deductive reasoning steps to iteratively construct target expressions, where each step involves a primitive operation over two quantities defining their relation. Through extensive experiments on four benchmark datasets, we show that the proposed model significantly outperforms existing strong baselines. We further demonstrate that the deductive procedure not only presents more explainable steps but also enables us to make more accurate predictions on questions that require more complex reasoning.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Math23KRoberta-DeductReasonerAccuracy (5-fold)83Unverified
MathQARoberta-DeductReasonerAnswer Accuracy78.6Unverified
MAWPSRoberta-DeductReasonerAccuracy (%)92Unverified
SVAMPRoberta-DeductReasonerExecution Accuracy47.3Unverified

Reproductions