Zero-Shot Learning
Zero-shot learning (ZSL) is a model's ability to detect classes never seen during training. The condition is that the classes are not known during supervised learning.
Earlier work in zero-shot learning use attributes in a two-step approach to infer unknown classes. In the computer vision context, more recent advances learn mappings from image feature space to semantic space. Other approaches learn non-linear multimodal embeddings. In the modern NLP context, language models can be evaluated on downstream tasks without fine tuning.
Benchmark datasets for zero-shot learning include aPY, AwA, and CUB, among others.
( Image credit: Prototypical Networks for Few shot Learning in PyTorch )
Further readings:
Papers
Showing 11–20 of 1864 papers
All datasetsCUB-200-2011MedConceptsQASUN AttributeAwA2Caltech-101CIFAR-10CIFAR-100COCO-MLTDTDFGVC-AircraftFlowers-102Food-101
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZeroDiff | average top-1 classification accuracy | 87.5 | — | Unverified |
| 2 | DUET | average top-1 classification accuracy | 72.3 | — | Unverified |
| 3 | Composer | average top-1 classification accuracy | 69.4 | — | Unverified |
| 4 | HDC-ZSC-MLP | average top-1 classification accuracy | 65.6 | — | Unverified |
| 5 | ZSL_TF-VAEGAN | average top-1 classification accuracy | 64.9 | — | Unverified |
| 6 | ZLaP | Accuracy | 64.3 | — | Unverified |
| 7 | ZLaP* | Accuracy | 64.2 | — | Unverified |
| 8 | HDC-ZSC | average top-1 classification accuracy | 63.8 | — | Unverified |
| 9 | SPOT | average top-1 classification accuracy | 62.9 | — | Unverified |
| 10 | f-VAEGAN-D2 | average top-1 classification accuracy | 61 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | dmis-lab/biobert-v1.1 | Accuracy | 26.15 | — | Unverified |
| 2 | meta-llama/Meta-Llama-3-8B-Instruct | Accuracy | 25.84 | — | Unverified |
| 3 | epfl-llm/meditron-7b | Accuracy | 25.75 | — | Unverified |
| 4 | dmis-lab/meerkat-7b-v1.0 | Accuracy | 25.68 | — | Unverified |
| 5 | meta-llama/Meta-Llama-3-8B-Instruct | Accuracy | 25.65 | — | Unverified |
| 6 | HuggingFaceH4/zephyr-7b-beta | Accuracy | 25.54 | — | Unverified |
| 7 | dmis-lab/biobert-v1.1 | Accuracy | 25.46 | — | Unverified |
| 8 | epfl-llm/meditron-70b | Accuracy | 25.36 | — | Unverified |
| 9 | epfl-llm/meditron-70b | Accuracy | 25.26 | — | Unverified |
| 10 | HuggingFaceH4/zephyr-7b-beta | Accuracy | 25.06 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZeroDiff | average top-1 classification accuracy | 77.3 | — | Unverified |
| 2 | SPOT (VAEGAN) | average top-1 classification accuracy | 66.04 | — | Unverified |
| 3 | ZSL_TF-VAEGAN | average top-1 classification accuracy | 66 | — | Unverified |
| 4 | f-VAEGAN | average top-1 classification accuracy | 64.7 | — | Unverified |
| 5 | DUET (Ours) | average top-1 classification accuracy | 64.4 | — | Unverified |
| 6 | LisGAN | average top-1 classification accuracy | 61.7 | — | Unverified |
| 7 | TCN | average top-1 classification accuracy | 61.5 | — | Unverified |
| 8 | f-CLSWGAN | average top-1 classification accuracy | 60.8 | — | Unverified |
| 9 | Cycle-WGAN | average top-1 classification accuracy | 59.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZeroDiff | average top-1 classification accuracy | 86.4 | — | Unverified |
| 2 | ZSL-KG | average top-1 classification accuracy | 78.08 | — | Unverified |
| 3 | ZSL_TF-VAEGAN | average top-1 classification accuracy | 72.2 | — | Unverified |
| 4 | DUET (Ours) | average top-1 classification accuracy | 69.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SPOT | average top-1 classification accuracy | 71.9 | — | Unverified |
| 2 | ZSL_TF-VAEGAN | average top-1 classification accuracy | 70.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CLIP(ViT-B/16) | Average mAP | 85.77 | — | Unverified |
| 2 | CLIP(ResNet-50) | Average mAP | 84.3 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZSL-KG | Top-1 | 60.54 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | zsl_ADA | Average Per-Class Accuracy | 70.9 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZLaP* | Accuracy | 63.2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MSDA | Pearson correlation coefficient (PCC) | 0.52 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | SeViLA | Accuracy | 72.3 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | M^2-Encoder | Accuracy | 80.7 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | FrozenBiLM | Accuracy | 51.5 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | CZSL | A-acc | 36 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZS3Net | k=10 mIOU | 26.3 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ZSL-KG | Accuracy | 88.98 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | VideoChat2 | Accuracy | 40.6 | — | Unverified |