SOTAVerified

Slot Filling

The goal of Slot Filling is to identify from a running dialog different slots, which correspond to different parameters of the user’s query. For instance, when a user queries for nearby restaurants, key slots for location and preferred food are required for a dialog system to retrieve the appropriate information. Thus, the main challenge in the slot-filling task is to extract the target entity.

Source: Real-time On-Demand Crowd-powered Entity Extraction

Image credit: Robust Retrieval Augmented Generation for Zero-shot Slot Filling

Papers

Showing 6170 of 458 papers

TitleStatusHype
BERT for Joint Intent Classification and Slot FillingCode1
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLPCode1
A weakly supervised sequence tagging and grammar induction approach to semantic frame slot filling0
Automatic Intent-Slot Induction for Dialogue Systems0
An Empirical Study of Automatic Chinese Word Segmentation for Spoken Language Understanding and Named Entity Recognition0
Automated Graph Generation at Sentence Level for Reading Comprehension Based on Conceptual Graphs0
An Approach to Build Zero-Shot Slot-Filling System for Industry-Grade Conversational Assistants0
A Fine-tuned Wav2vec 2.0/HuBERT Benchmark For Speech Emotion Recognition, Speaker Verification and Spoken Language Understanding0
Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?0
Augmenting Task-Oriented Dialogue Systems with Relation Extraction0
Show:102550
← PrevPage 7 of 46Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1single ngramKILT-AC73.2Unverified
2KGI_1KILT-AC72.31Unverified
3MetaRAGKILT-AC71.1Unverified
4KGI_0 (reupload)KILT-AC68.32Unverified
5WikipediaKILT-AC67.2Unverified
6Multitask DPR + BARTKILT-AC50.64Unverified
710kKILT-AC41.34Unverified
8DensePhrasesKILT-AC41.34Unverified
9RAGKILT-AC36.83Unverified
10Coop. Distil BertKILT-AC34.13Unverified
#ModelMetricClaimedVerifiedStatus
1Re2GKILT-AC75.84Unverified
2KGI_1KILT-AC69.14Unverified
3WikipediaKILT-AC64.64Unverified
4MetaRAGKILT-AC61.88Unverified
5single ngramKILT-AC60.08Unverified
6KGI_0 (reupload)KILT-AC55.54Unverified
7Coop. DistilBertKILT-AC36.68Unverified
8DensePhrasesKILT-AC27.84Unverified
910kKILT-AC27.84Unverified
10RAGKILT-AC23.12Unverified
#ModelMetricClaimedVerifiedStatus
1BiSLUMicro F197.2Unverified
2SLIM (PACL)Micro F196.8Unverified
3SLIMMicro F196.5Unverified
4Uni-MISMicro F196.4Unverified
5TFMNMicro F196.4Unverified
6TFMN (PACL)Micro F196.3Unverified
7RoBERTa (PACL)Micro F196.2Unverified
8DGIFMicro F195.9Unverified
9SSRANMicro F195.8Unverified
10MISCAMicro F195.2Unverified
#ModelMetricClaimedVerifiedStatus
1MISCAMicro F190.5Unverified
2Co-guiding NetMicro F189.8Unverified
3SSRANMicro F189.4Unverified
4BiSLUMicro F189.4Unverified
5UGENMicro F189.2Unverified
6Topic InformationMicro F188.7Unverified
7SLIMMicro F188.5Unverified
8Global Intent-Slot Co-occurenceMicro F188.5Unverified
9DGIFMicro F188.5Unverified
10Uni-MISMicro F188.3Unverified
#ModelMetricClaimedVerifiedStatus
1CTRANF10.98Unverified
2Bi-model with a decoderF10.97Unverified
3Joint BERTF10.96Unverified
4Stack-Propagation (+BERT)F10.96Unverified
5JointBERT-CAEF10.96Unverified
6AGIFF10.96Unverified
7Joint BERT + CRFF10.96Unverified
8Attention Encoder-Decoder NNF10.96Unverified
9Context EncoderF10.96Unverified
10SF-IDF10.96Unverified
#ModelMetricClaimedVerifiedStatus
1CTRANF198.3Unverified
2Stack-Propagation (+BERT)F197Unverified
3JointBERT-CAEF197Unverified
4AGIFF194.8Unverified
5Stack-PropagationF194.2Unverified
6Context EncoderF193.6Unverified
7SF-IDF192.23Unverified
8Slot-Gated BLSTM with AttensionF188.8Unverified
9DecomposedMetaSLF1 (1-shot) avg74.89Unverified
10Capsule-NLUF10.92Unverified
#ModelMetricClaimedVerifiedStatus
1TDT 0-6F10.81Unverified
2Partially Fine-tuned HuBERTF10.75Unverified
3Multi-SLURPF10.64Unverified
4Finstreder (Conformer)F10.4Unverified
5Finstreder (Quartznet)F10.31Unverified
#ModelMetricClaimedVerifiedStatus
1XLM-R BaseSlot F1 Score83.6Unverified
2mT5 Base (encoder-only)Slot F1 Score82.2Unverified
3mT5 Base (text-to-text)Slot F1 Score81.3Unverified
#ModelMetricClaimedVerifiedStatus
1JointBERT-CAESlot F195.5Unverified
#ModelMetricClaimedVerifiedStatus
1CM-NetF186.16Unverified
#ModelMetricClaimedVerifiedStatus
1MIDASF1 score98.56Unverified
#ModelMetricClaimedVerifiedStatus
1MIDASF1 score99.28Unverified
#ModelMetricClaimedVerifiedStatus
1Fashion GAEFITB96.9Unverified
#ModelMetricClaimedVerifiedStatus
1General SLU Model w/ ProfileF10.83Unverified