SOTAVerified

Zero-Shot Learning

Zero-shot learning (ZSL) is a model's ability to detect classes never seen during training. The condition is that the classes are not known during supervised learning.

Earlier work in zero-shot learning use attributes in a two-step approach to infer unknown classes. In the computer vision context, more recent advances learn mappings from image feature space to semantic space. Other approaches learn non-linear multimodal embeddings. In the modern NLP context, language models can be evaluated on downstream tasks without fine tuning.

Benchmark datasets for zero-shot learning include aPY, AwA, and CUB, among others.

( Image credit: Prototypical Networks for Few shot Learning in PyTorch )

Further readings:

Papers

Showing 201250 of 1864 papers

TitleStatusHype
Learning Adversarial Semantic Embeddings for Zero-Shot Recognition in Open WorldsCode1
Distilling Large Vision-Language Model with Out-of-Distribution GeneralizabilityCode1
The mapKurator System: A Complete Pipeline for Extracting and Linking Text from Historical MapsCode1
Enlighten Anything: When Segment Anything Model Meets Low-Light Image EnhancementCode1
Enhancing CLIP with CLIP: Exploring Pseudolabeling for Limited-Label Prompt TuningCode1
Layout and Task Aware Instruction Prompt for Zero-shot Document Image Question AnsweringCode1
UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment AnalysisCode1
FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion ModelsCode1
Learning Conditional Attributes for Compositional Zero-Shot LearningCode1
Improved Probabilistic Image-Text RepresentationsCode1
Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language ModelsCode1
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot LearningCode1
CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot LearningCode1
Multilingual Text-to-Speech Synthesis for Turkic Languages Using TransliterationCode1
Parts of Speech-Grounded Subspaces in Vision-Language ModelsCode1
S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist CaptionsCode1
Prompting Language-Informed Distribution for Compositional Zero-Shot LearningCode1
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense RetrievalCode1
MedBLIP: Bootstrapping Language-Image Pre-training from 3D Medical Images and TextsCode1
Dual Intent Enhanced Graph Neural Network for Session-based New Item RecommendationCode1
Stance Detection: A Practical Guide to Classifying Political Beliefs in TextCode1
Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodlesCode1
Unicorn: A Unified Multi-tasking Model for Supporting Matching Tasks in Data IntegrationCode1
The Parrot Dilemma: Human-Labeled vs. LLM-augmented Data in Classification TasksCode1
Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLMCode1
Segment Anything Model for Medical Image Analysis: an Experimental StudyCode1
Text2Seg: Remote Sensing Image Semantic Segmentation via Text-Guided Visual Foundation ModelsCode1
TagCLIP: Improving Discrimination Ability of Open-Vocabulary Semantic SegmentationCode1
SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)Code1
A Closer Look at the Explainability of Contrastive Language-Image Pre-trainingCode1
Interaction-Aware Prompting for Zero-Shot Spatio-Temporal Action DetectionCode1
Zero-shot Medical Image Translation via Frequency-Guided Diffusion ModelsCode1
Exploring Vision-Language Models for Imbalanced LearningCode1
AutoLabel: CLIP-based framework for Open-set Video Domain AdaptationCode1
Learning Attention as Disentangler for Compositional Zero-shot LearningCode1
Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human AttentionCode1
Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot LearningCode1
Progressive Semantic-Visual Mutual Adaption for Generalized Zero-Shot LearningCode1
The effectiveness of MAE pre-pretraining for billion-scale pretrainingCode1
MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language KnowledgeCode1
Bi-directional Distribution Alignment for Transductive Zero-Shot LearningCode1
Robust Contrastive Language-Image Pre-training against Data Poisoning and Backdoor AttacksCode1
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language GenerationCode1
Teaching CLIP to Count to TenCode1
Text Classification in the Wild: a Large-scale Long-tailed Name Normalization DatasetCode1
A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and InteractivityCode1
Diversity is Definitely Needed: Improving Model-Agnostic Zero-shot Classification via Stable DiffusionCode1
CHiLS: Zero-Shot Image Classification with Hierarchical Label SetsCode1
Open-VCLIP: Transforming CLIP to an Open-vocabulary Video Model via Interpolated Weight OptimizationCode1
Learning Customized Visual Models with Retrieval-Augmented KnowledgeCode1
Show:102550
← PrevPage 5 of 38Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ZeroDiffaverage top-1 classification accuracy87.5Unverified
2DUETaverage top-1 classification accuracy72.3Unverified
3Composeraverage top-1 classification accuracy69.4Unverified
4HDC-ZSC-MLPaverage top-1 classification accuracy65.6Unverified
5ZSL_TF-VAEGANaverage top-1 classification accuracy64.9Unverified
6ZLaPAccuracy64.3Unverified
7ZLaP*Accuracy64.2Unverified
8HDC-ZSCaverage top-1 classification accuracy63.8Unverified
9SPOTaverage top-1 classification accuracy62.9Unverified
10f-VAEGAN-D2average top-1 classification accuracy61Unverified
#ModelMetricClaimedVerifiedStatus
1dmis-lab/biobert-v1.1Accuracy26.15Unverified
2meta-llama/Meta-Llama-3-8B-InstructAccuracy25.84Unverified
3epfl-llm/meditron-7bAccuracy25.75Unverified
4dmis-lab/meerkat-7b-v1.0Accuracy25.68Unverified
5meta-llama/Meta-Llama-3-8B-InstructAccuracy25.65Unverified
6HuggingFaceH4/zephyr-7b-betaAccuracy25.54Unverified
7dmis-lab/biobert-v1.1Accuracy25.46Unverified
8epfl-llm/meditron-70bAccuracy25.36Unverified
9epfl-llm/meditron-70bAccuracy25.26Unverified
10HuggingFaceH4/zephyr-7b-betaAccuracy25.06Unverified
#ModelMetricClaimedVerifiedStatus
1ZeroDiffaverage top-1 classification accuracy77.3Unverified
2SPOT (VAEGAN)average top-1 classification accuracy66.04Unverified
3ZSL_TF-VAEGANaverage top-1 classification accuracy66Unverified
4f-VAEGANaverage top-1 classification accuracy64.7Unverified
5DUET (Ours)average top-1 classification accuracy64.4Unverified
6LisGANaverage top-1 classification accuracy61.7Unverified
7TCNaverage top-1 classification accuracy61.5Unverified
8f-CLSWGANaverage top-1 classification accuracy60.8Unverified
9Cycle-WGANaverage top-1 classification accuracy59.9Unverified
#ModelMetricClaimedVerifiedStatus
1ZeroDiffaverage top-1 classification accuracy86.4Unverified
2ZSL-KGaverage top-1 classification accuracy78.08Unverified
3ZSL_TF-VAEGANaverage top-1 classification accuracy72.2Unverified
4DUET (Ours)average top-1 classification accuracy69.9Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaPAccuracy84Unverified
2ZLaP*Accuracy83.1Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy93.6Unverified
2ZLaPAccuracy93.4Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy74.2Unverified
2ZLaPAccuracy74Unverified
#ModelMetricClaimedVerifiedStatus
1ViT-B/16Average mAP60.17Unverified
2ResNet-50Average mAP56.19Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaPAccuracy51.2Unverified
2ZLaP*Accuracy51Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaPAccuracy29.1Unverified
2ZLaP*Accuracy29Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaPAccuracy75.9Unverified
2ZLaP*Accuracy75.5Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy87.9Unverified
2ZLaPAccuracy87.8Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaPTop 1 Accuracy72.1Unverified
2ZLaP*Top 1 Accuracy72.1Unverified
#ModelMetricClaimedVerifiedStatus
1HiTeAAccuracy21.7Unverified
2HiTeAAccuracy0.46Unverified
#ModelMetricClaimedVerifiedStatus
1HiTeAAccuracy37.4Unverified
2HiTeAAccuracy0.56Unverified
#ModelMetricClaimedVerifiedStatus
1SPOTaverage top-1 classification accuracy71.9Unverified
2ZSL_TF-VAEGANaverage top-1 classification accuracy70.8Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaPAccuracy90Unverified
2ZLaP*Accuracy89Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy71.8Unverified
2ZLaPAccuracy71.2Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy71.4Unverified
2ZLaPAccuracy71Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy76.3Unverified
2ZLaPAccuracy76.3Unverified
#ModelMetricClaimedVerifiedStatus
1CLIP(ViT-B/16)Average mAP85.77Unverified
2CLIP(ResNet-50)Average mAP84.3Unverified
#ModelMetricClaimedVerifiedStatus
1ZSL-KGTop-160.54Unverified
#ModelMetricClaimedVerifiedStatus
1zsl_ADAAverage Per-Class Accuracy70.9Unverified
#ModelMetricClaimedVerifiedStatus
1ZLaP*Accuracy63.2Unverified
#ModelMetricClaimedVerifiedStatus
1MSDAPearson correlation coefficient (PCC)0.52Unverified
#ModelMetricClaimedVerifiedStatus
1SeViLAAccuracy72.3Unverified
#ModelMetricClaimedVerifiedStatus
1M^2-EncoderAccuracy80.7Unverified
#ModelMetricClaimedVerifiedStatus
1FrozenBiLMAccuracy51.5Unverified
#ModelMetricClaimedVerifiedStatus
1CZSLA-acc36Unverified
#ModelMetricClaimedVerifiedStatus
1ZS3Netk=10 mIOU26.3Unverified
#ModelMetricClaimedVerifiedStatus
1ZSL-KGAccuracy88.98Unverified
#ModelMetricClaimedVerifiedStatus
1VideoChat2Accuracy40.6Unverified