Spoken Language Understanding on the Edge
2018-10-30Code Available1· sign in to hype
Alaa Saade, Alice Coucke, Alexandre Caulier, Joseph Dureau, Adrien Ball, Théodore Bluche, David Leroy, Clément Doumouro, Thibault Gisselbrecht, Francesco Caltagirone, Thibaut Lavril, Maël Primet
Code Available — Be the first to reproduce this paper.
ReproduceCode
Abstract
We consider the problem of performing Spoken Language Understanding (SLU) on small devices typical of IoT applications. Our contributions are twofold. First, we outline the design of an embedded, private-by-design SLU system and show that it has performance on par with cloud-based commercial solutions. Second, we release the datasets used in our experiments in the interest of reproducibility and in the hope that they can prove useful to the SLU community.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Snips-SmartLights | Snips | Accuracy (%) | 84.2 | — | Unverified |
| Snips-SmartLights | Accuracy (%) | 79.3 | — | Unverified | |
| Snips-SmartSpeaker | Snips | Accuracy-EN (%) | 68.7 | — | Unverified |
| Snips-SmartSpeaker | Accuracy-EN (%) | 47.8 | — | Unverified |