SOTAVerified

NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoning

2021-05-29Joint Conference on Lexical and Computational SemanticsCode Available1· sign in to hype

Zeming Chen, Qiyue Gao, Lawrence S. Moss

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have their advantages and weaknesses. However, currently, no method combines them in a system to solve the task of NLI. To merge symbolic and deep learning methods, we propose an inference framework called NeuralLog, which utilizes both a monotonicity-based logical inference engine and a neural network language model for phrase alignment. Our framework models the NLI task as a classic search problem and uses the beam search algorithm to search for optimal inference paths. Experiments show that our joint logic and neural inference system improves accuracy on the NLI task and can achieve state-of-art accuracy on the SICK and MED datasets.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
MEDNeuralLog1:1 Accuracy0.93Unverified
SICKNeuralLog1:1 Accuracy0.9Unverified

Reproductions