SOTAVerified

The Inception Team at NSURL-2019 Task 8: Semantic Question Similarity in Arabic

2020-04-24NSURL 2019Unverified0· sign in to hype

Hana Al-Theiabat, Aisha Al-Sadi

Unverified — Be the first to reproduce this paper.

Reproduce

Abstract

This paper describes our method for the task of Semantic Question Similarity in Arabic in the workshop on NLP Solutions for Under-Resourced Languages (NSURL). The aim is to build a model that is able to detect similar semantic questions in the Arabic language for the provided dataset. Different methods of determining questions similarity are explored in this work. The proposed models achieved high F1-scores, which range from (88% to 96%). Our official best result is produced from the ensemble model of using a pre-trained multilingual BERT model with different random seeds with 95.924% F1-Score, which ranks the first among nine participants teams.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Q2Q Arabic BenchmarkEnsemble multilingual BERT modelF1 score0.96Unverified

Reproductions