SemEval-2019 Task 10: Math Question Answering
2019-06-01SEMEVAL 2019Code Available0· sign in to hype
Mark Hopkins, Ronan Le Bras, Cristian Petrescu-Prahova, Gabriel Stanovsky, Hannaneh Hajishirzi, Rik Koncel-Kedziorski
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/allenai/semeval-2019-task-10OfficialIn papernone★ 0
Abstract
We report on the SemEval 2019 task on math question answering. We provided a question set derived from Math SAT practice exams, including 2778 training questions and 1082 test questions. For a significant subset of these questions, we also provided SMT-LIB logical form annotations and an interpreter that could solve these logical forms. Systems were evaluated based on the percentage of correctly answered questions. The top system correctly answered 45\% of the test questions, a considerable improvement over the 17\% random guessing baseline.