Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1701–1725 of 6661 papers

Title	Date	Tasks	Status	Hype
DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network	Mar 14, 2021	Contrastive LearningDiversity	CodeCode Available	1
Reconsidering Representation Alignment for Multi-view Clustering	Mar 13, 2021	ClusteringContrastive Learning	CodeCode Available	1
WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training	Mar 11, 2021	Contrastive LearningGPU	CodeCode Available	1
3D Human Pose, Shape and Texture from Low-Resolution Images and Videos	Mar 11, 2021	3D human pose and shape estimationContrastive Learning	CodeCode Available	1
Spatially Consistent Representation Learning	Mar 10, 2021	Contrastive Learningimage-classification	CodeCode Available	1
VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples	Mar 10, 2021	Action RecognitionContrastive Learning	CodeCode Available	1
FSCE: Few-Shot Object Detection via Contrastive Proposal Encoding	Mar 10, 2021	Contrastive LearningCross-Domain Few-Shot Object Detection	CodeCode Available	1
Doubly Contrastive Deep Clustering	Mar 9, 2021	ClusteringContrastive Learning	CodeCode Available	1
SimTriplet: Simple Triplet Representation Learning with a Single GPU	Mar 9, 2021	Contrastive LearningGPU	CodeCode Available	1
Self-Supervised Longitudinal Neighbourhood Embedding	Mar 5, 2021	Contrastive LearningRepresentation Learning	CodeCode Available	1
Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images	Mar 5, 2021	Anomaly DetectionContrastive Learning	CodeCode Available	1
SoundCLR: Contrastive Learning of Representations For Improved Environmental Sound Classification	Mar 2, 2021	Contrastive LearningData Augmentation	CodeCode Available	1
Task-Adaptive Neural Network Search with Meta-Contrastive Learning	Mar 2, 2021	AutoMLContrastive Learning	CodeCode Available	1
Partially View-aligned Representation Learning with Noise-robust Contrastive Loss	Mar 1, 2021	ClusteringContrastive Learning	CodeCode Available	1
Panoramic Panoptic Segmentation: Towards Complete Surrounding Understanding via Unsupervised Contrastive Learning	Mar 1, 2021	Contrastive LearningPanoptic Segmentation	CodeCode Available	1
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning	Feb 27, 2021	Anomaly DetectionContrastive Learning	CodeCode Available	1
Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View	Feb 21, 2021	Contrastive LearningDisentanglement	CodeCode Available	1
On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning	Feb 20, 2021	Adversarial AttackAdversarial Robustness	CodeCode Available	1
Molecular Contrastive Learning of Representations via Graph Neural Networks	Feb 19, 2021	BIG-bench Machine LearningContrastive Learning	CodeCode Available	1
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration	Feb 17, 2021	Contrastive LearningSelf-Supervised Learning	CodeCode Available	1
Contrastive Learning Inverts the Data Generating Process	Feb 17, 2021	Contrastive LearningDisentanglement	CodeCode Available	1
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining	Feb 16, 2021	Contrastive LearningGPU	CodeCode Available	1
Large-Scale Representation Learning on Graphs via Bootstrapping	Feb 12, 2021	Contrastive LearningGraph Representation Learning	CodeCode Available	1
Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuning	Feb 12, 2021	Contrastive Learningimage-classification	CodeCode Available	1
Negative Data Augmentation	Feb 9, 2021	Action RecognitionAnomaly Detection	CodeCode Available	1

Show:10 25 50

← PrevPage 69 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified