SOTAVerified

Timers and Such: A Practical Benchmark for Spoken Language Understanding with Numbers

2021-04-04Code Available0· sign in to hype

Loren Lugosch, Piyush Papreja, Mirco Ravanelli, Abdelwahab Heba, Titouan Parcollet

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

This paper introduces Timers and Such, a new open source dataset of spoken English commands for common voice control use cases involving numbers. We describe the gap in existing spoken language understanding datasets that Timers and Such fills, the design and creation of the dataset, and experiments with a number of ASR-based and end-to-end baseline models, the code for which has been made available as part of the SpeechBrain toolkit.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Timers and SuchBaselineAccuracy (%)81.6Unverified

Reproductions