Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 351–375 of 6661 papers

Title	Date	Tasks	Status	Hype	Score
Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddings	Jan 28, 2024	Contrastive LearningDescriptive	CodeCode Available	1	5
A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning	Apr 28, 2021	Contrastive LearningSelf-Supervised Learning	CodeCode Available	1	5
Unraveling Instance Associations: A Closer Look for Audio-Visual Segmentation	Apr 6, 2023	audio-visual learningContrastive Learning	CodeCode Available	1	5
Biomedical Entity Linking with Contrastive Context Matching	Jun 14, 2021	ArticlesContrastive Learning	CodeCode Available	1	5
PITN: Physics-Informed Temporal Networks for Cuffless Blood Pressure Estimation	Aug 16, 2024	Blood pressure estimationContrastive Learning	CodeCode Available	1	5
Contrastive Embeddings for Neural Architectures	Feb 8, 2021	Contrastive LearningNeural Architecture Search	CodeCode Available	1	5
Contrastive Fine-grained Class Clustering via Generative Adversarial Networks	Dec 30, 2021	ClusteringContrastive Learning	CodeCode Available	1	5
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity	Jun 18, 2024	Contrastive LearningLanguage Modelling	CodeCode Available	1	5
Adversarial Contrastive Learning for Evidence-aware Fake News Detection with Graph Neural Networks	Oct 11, 2022	Contrastive LearningFake News Detection	CodeCode Available	1	5
3D Human Action Representation Learning via Cross-View Consistency Pursuit	Apr 29, 2021	Action RecognitionContrastive Learning	CodeCode Available	1	5
Adversarial Contrastive Learning via Asymmetric InfoNCE	Jul 18, 2022	Adversarial RobustnessContrastive Learning	CodeCode Available	1	5
CLIBD: Bridging Vision and Genomics for Biodiversity Monitoring at Scale	May 27, 2024	Contrastive LearningZero-Shot Learning	CodeCode Available	1	5
Black-Box Attack against GAN-Generated Image Detector with Contrastive Perturbation	Nov 7, 2022	Contrastive LearningDecoder	CodeCode Available	1	5
Boosting Few-Shot Classification with View-Learnable Contrastive Learning	Jul 20, 2021	ClassificationContrastive Learning	CodeCode Available	1	5
Black Box Few-Shot Adaptation for Vision-Language models	Apr 4, 2023	Contrastive LearningPrompt Learning	CodeCode Available	1	5
Blind Localization and Clustering of Anomalies in Textures	Apr 18, 2024	Anomaly DetectionAnomaly Localization	CodeCode Available	1	5
A picture of the space of typical learnable tasks	Oct 31, 2022	Contrastive LearningMeta-Learning	CodeCode Available	1	5
Adversarial Examples Are Not Real Features	Oct 29, 2023	Contrastive LearningSelf-Supervised Learning	CodeCode Available	1	5
Applying Self-supervised Learning to Network Intrusion Detection for Network Flows with Graph Neural Network	Mar 3, 2024	Binary ClassificationContrastive Learning	CodeCode Available	1	5
A Closer Look at Self-Supervised Lightweight Vision Transformers	May 28, 2022	Contrastive Learningimage-classification	CodeCode Available	1	5
3D Human Pose, Shape and Texture from Low-Resolution Images and Videos	Mar 11, 2021	3D human pose and shape estimationContrastive Learning	CodeCode Available	1	5
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval	Jul 1, 2020	Contrastive LearningPassage Retrieval	CodeCode Available	1	5
A Practical Contrastive Learning Framework for Single-Image Super-Resolution	Nov 27, 2021	Contrastive LearningImage Restoration	CodeCode Available	1	5
Adversarial Graph Augmentation to Improve Graph Contrastive Learning	Jun 10, 2021	Contrastive LearningSelf-Supervised Learning	CodeCode Available	1	5
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning	Feb 27, 2021	Anomaly DetectionContrastive Learning	CodeCode Available	1	5

Show:10 25 50

← PrevPage 15 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified