Zero-Shot Learning
Zero-shot learning (ZSL) is a model's ability to detect classes never seen during training. The condition is that the classes are not known during supervised learning.
Earlier work in zero-shot learning use attributes in a two-step approach to infer unknown classes. In the computer vision context, more recent advances learn mappings from image feature space to semantic space. Other approaches learn non-linear multimodal embeddings. In the modern NLP context, language models can be evaluated on downstream tasks without fine tuning.
Benchmark datasets for zero-shot learning include aPY, AwA, and CUB, among others.
( Image credit: Prototypical Networks for Few shot Learning in PyTorch )
Further readings:
Papers
Showing 1–10 of 1864 papers
All datasetsCUB-200-2011MedConceptsQASUN AttributeAwA2Caltech-101CIFAR-10CIFAR-100COCO-MLTDTDFGVC-AircraftFlowers-102Food-101
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | dmis-lab/biobert-v1.1 | Accuracy | 26.15 | — | Unverified |
| 2 | meta-llama/Meta-Llama-3-8B-Instruct | Accuracy | 25.84 | — | Unverified |
| 3 | epfl-llm/meditron-7b | Accuracy | 25.75 | — | Unverified |
| 4 | dmis-lab/meerkat-7b-v1.0 | Accuracy | 25.68 | — | Unverified |
| 5 | meta-llama/Meta-Llama-3-8B-Instruct | Accuracy | 25.65 | — | Unverified |
| 6 | HuggingFaceH4/zephyr-7b-beta | Accuracy | 25.54 | — | Unverified |
| 7 | dmis-lab/biobert-v1.1 | Accuracy | 25.46 | — | Unverified |
| 8 | epfl-llm/meditron-70b | Accuracy | 25.36 | — | Unverified |
| 9 | epfl-llm/meditron-70b | Accuracy | 25.26 | — | Unverified |
| 10 | HuggingFaceH4/zephyr-7b-beta | Accuracy | 25.06 | — | Unverified |