Project PIAF: Building a Native French Question-Answering Dataset
2020-07-02LREC 2020Code Available1· sign in to hype
Rachel Keraron, Guillaume Lancrenon, Mathilde Bras, Frédéric Allary, Gilles Moyse, Thomas Scialom, Edmundo-Pavel Soriano-Morales, Jacopo Staiano
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/etalab/piafOfficialIn papernone★ 90
Abstract
Motivated by the lack of data for non-English languages, in particular for the evaluation of downstream tasks such as Question Answering, we present a participatory effort to collect a native French Question Answering Dataset. Furthermore, we describe and publicly release the annotation tool developed for our collection effort, along with the data obtained and preliminary baselines.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| FQuAD | Camembert-Base-SquadFR-Fquad-Piaf | EM | 77 | — | Unverified |