SOTAVerified

Spoken Language Understanding

Papers

No papers found.

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Finstreder (Conformer + AMT, character-based)Accuracy (%)99.8—Unverified
2UniverSLUAccuracy (%)99.8—Unverified
3Finstreder (Quartznet + AMT)Accuracy (%)99.7—Unverified
4textual-kd-sluAccuracy (%)99.7—Unverified
5Wav2Vec2.0-ClassifierAccuracy (%)99.7—Unverified
6E2E SLP two-stepAccuracy (%)99.7—Unverified
7Wav2vec 2.0 SSLAccuracy (%)99.6—Unverified
8Finstreder (Conformer)Accuracy (%)99.5—Unverified
9AT-ATAccuracy (%)99.5—Unverified
10BERT, AC PretrainingAccuracy (%)99.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Finstreder (Conformer, character-based)Accuracy (%)89—Unverified
2Finstreder (Conformer)Accuracy (%)88—Unverified
3AT-ATAccuracy (%)84.9—Unverified
4Finstreder (Quartznet)Accuracy (%)84.8—Unverified
5SnipsAccuracy (%)84.2—Unverified
6GoogleAccuracy (%)79.3—Unverified
7Real + syntheticAccuracy (%)71.4—Unverified
#ModelMetricClaimedVerifiedStatus
1Finstreder (Conformer, character-based)Accuracy-EN (%)87.9—Unverified
2Finstreder (Conformer)Accuracy-EN (%)80.4—Unverified
3Finstreder (Quartznet)Accuracy-EN (%)77.6—Unverified
4SnipsAccuracy-EN (%)68.7—Unverified
5GoogleAccuracy-EN (%)47.8—Unverified
#ModelMetricClaimedVerifiedStatus
1ALBERTF1 score77.1—Unverified
2SpeechBERTF1 score71.75—Unverified
3QANet + GANF1 score63.11—Unverified
4BaselineF1 score58.71—Unverified
#ModelMetricClaimedVerifiedStatus
1Finstreder (Conformer)Accuracy (%)95.4—Unverified
2Finstreder (Quartznet)Accuracy (%)90—Unverified
3BaselineAccuracy (%)81.6—Unverified