SOTAVerified

Slot Filling

The goal of Slot Filling is to identify from a running dialog different slots, which correspond to different parameters of the user’s query. For instance, when a user queries for nearby restaurants, key slots for location and preferred food are required for a dialog system to retrieve the appropriate information. Thus, the main challenge in the slot-filling task is to extract the target entity.

Source: Real-time On-Demand Crowd-powered Entity Extraction

Image credit: Robust Retrieval Augmented Generation for Zero-shot Slot Filling

Papers

Showing 451458 of 458 papers

TitleStatusHype
Relabeling Distantly Supervised Training Data for Temporal Knowledge Base Population0
Mining Search Query Logs for Spoken Language Understanding0
After Dialog Went Pervasive: Separating Dialog Behavior Modeling and Task Modeling0
Challenges in the Knowledge Base Population Slot Filling Task0
Linguistic Resources for Entity Linking Evaluation: from Monolingual to Cross-lingual0
Evaluation of Online Dialogue Policy Learning Techniques0
DBpedia: A Multilingual Cross-domain Knowledge Base0
A Statistical Spoken Dialogue System using Complex User Goals and Value Directed Compression0
Show:102550
← PrevPage 10 of 10Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1single ngramKILT-AC73.2Unverified
2KGI_1KILT-AC72.31Unverified
3MetaRAGKILT-AC71.1Unverified
4KGI_0 (reupload)KILT-AC68.32Unverified
5WikipediaKILT-AC67.2Unverified
6Multitask DPR + BARTKILT-AC50.64Unverified
710kKILT-AC41.34Unverified
8DensePhrasesKILT-AC41.34Unverified
9RAGKILT-AC36.83Unverified
10Coop. Distil BertKILT-AC34.13Unverified
#ModelMetricClaimedVerifiedStatus
1Re2GKILT-AC75.84Unverified
2KGI_1KILT-AC69.14Unverified
3WikipediaKILT-AC64.64Unverified
4MetaRAGKILT-AC61.88Unverified
5single ngramKILT-AC60.08Unverified
6KGI_0 (reupload)KILT-AC55.54Unverified
7Coop. DistilBertKILT-AC36.68Unverified
8DensePhrasesKILT-AC27.84Unverified
910kKILT-AC27.84Unverified
10RAGKILT-AC23.12Unverified
#ModelMetricClaimedVerifiedStatus
1BiSLUMicro F197.2Unverified
2SLIM (PACL)Micro F196.8Unverified
3SLIMMicro F196.5Unverified
4Uni-MISMicro F196.4Unverified
5TFMNMicro F196.4Unverified
6TFMN (PACL)Micro F196.3Unverified
7RoBERTa (PACL)Micro F196.2Unverified
8DGIFMicro F195.9Unverified
9SSRANMicro F195.8Unverified
10MISCAMicro F195.2Unverified
#ModelMetricClaimedVerifiedStatus
1MISCAMicro F190.5Unverified
2Co-guiding NetMicro F189.8Unverified
3BiSLUMicro F189.4Unverified
4SSRANMicro F189.4Unverified
5UGENMicro F189.2Unverified
6Topic InformationMicro F188.7Unverified
7SLIMMicro F188.5Unverified
8Global Intent-Slot Co-occurenceMicro F188.5Unverified
9DGIFMicro F188.5Unverified
10Uni-MISMicro F188.3Unverified
#ModelMetricClaimedVerifiedStatus
1CTRANF10.98Unverified
2Bi-model with a decoderF10.97Unverified
3JointBERT-CAEF10.96Unverified
4Joint BERTF10.96Unverified
5Stack-Propagation (+BERT)F10.96Unverified
6AGIFF10.96Unverified
7Joint BERT + CRFF10.96Unverified
8Attention Encoder-Decoder NNF10.96Unverified
9Context EncoderF10.96Unverified
10SF-IDF10.96Unverified
#ModelMetricClaimedVerifiedStatus
1CTRANF198.3Unverified
2Stack-Propagation (+BERT)F197Unverified
3JointBERT-CAEF197Unverified
4AGIFF194.8Unverified
5Stack-PropagationF194.2Unverified
6Context EncoderF193.6Unverified
7SF-IDF192.23Unverified
8Slot-Gated BLSTM with AttensionF188.8Unverified
9DecomposedMetaSLF1 (1-shot) avg74.89Unverified
10Capsule-NLUF10.92Unverified
#ModelMetricClaimedVerifiedStatus
1TDT 0-6F10.81Unverified
2Partially Fine-tuned HuBERTF10.75Unverified
3Multi-SLURPF10.64Unverified
4Finstreder (Conformer)F10.4Unverified
5Finstreder (Quartznet)F10.31Unverified
#ModelMetricClaimedVerifiedStatus
1XLM-R BaseSlot F1 Score83.6Unverified
2mT5 Base (encoder-only)Slot F1 Score82.2Unverified
3mT5 Base (text-to-text)Slot F1 Score81.3Unverified
#ModelMetricClaimedVerifiedStatus
1JointBERT-CAESlot F195.5Unverified
#ModelMetricClaimedVerifiedStatus
1CM-NetF186.16Unverified
#ModelMetricClaimedVerifiedStatus
1MIDASF1 score98.56Unverified
#ModelMetricClaimedVerifiedStatus
1MIDASF1 score99.28Unverified
#ModelMetricClaimedVerifiedStatus
1Fashion GAEFITB96.9Unverified
#ModelMetricClaimedVerifiedStatus
1General SLU Model w/ ProfileF10.83Unverified