Luminoso at SemEval-2018 Task 10: Distinguishing Attributes Using Text Corpora and Relational Knowledge
2018-06-05SEMEVAL 2018Code Available0· sign in to hype
Robyn Speer, Joanna Lowry-Duda
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/LuminosoInsight/semeval-discriminattOfficialIn papernone★ 0
Abstract
Luminoso participated in the SemEval 2018 task on "Capturing Discriminative Attributes" with a system based on ConceptNet, an open knowledge graph focused on general knowledge. In this paper, we describe how we trained a linear classifier on a small number of semantically-informed features to achieve an F_1 score of 0.7368 on the task, close to the task's high score of 0.75.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| SemEval 2018 Task 10 | SVM with ConceptNet, Wikipedia articles and WordNet synonyms | F1-Score | 0.74 | — | Unverified |