Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 6601–6625 of 6661 papers

Title	Date	Tasks	Status	Hype
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels	Apr 28, 2020	AllAtari Games 100k	CodeCode Available	1
Audio-Visual Instance Discrimination with Cross-Modal Agreement	Apr 27, 2020	Action RecognitionAudio Classification	CodeCode Available	1
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning	Apr 24, 2020	Contrastive LearningDisentanglement	CodeCode Available	1
Supervised Contrastive Learning	Apr 23, 2020	Class Incremental LearningContrastive Learning	CodeCode Available	2
Distilling Localization for Self-Supervised Representation Learning	Apr 14, 2020	ColorizationContrastive Learning	—Unverified	0
CURL: Contrastive Unsupervised Representations for Reinforcement Learning	Apr 8, 2020	Atari GamesAtari Games 100k	CodeCode Available	1
Clustering based Contrastive Learning for Improving Face Representations	Apr 5, 2020	ClusteringContrastive Learning	—Unverified	0
Edge Guided GANs with Contrastive Learning for Semantic Image Synthesis	Mar 31, 2020	Contrastive LearningImage Generation	CodeCode Available	1
Semi-supervised Contrastive Learning Using Partial Label Information	Mar 17, 2020	Contrastive Learning	—Unverified	0
On Compositions of Transformations in Contrastive Self-Supervised Learning	Mar 9, 2020	Action RecognitionAudio Classification	CodeCode Available	1
Improved Baselines with Momentum Contrastive Learning	Mar 9, 2020	Contrastive LearningData Augmentation	CodeCode Available	1
Contrastive estimation reveals topic posterior information to linear models	Mar 4, 2020	ClassificationContrastive Learning	—Unverified	0
CoLES: Contrastive Learning for Event Sequences with Self-Supervision	Feb 19, 2020	Contrastive LearningMetric Learning	CodeCode Available	1
Convergence of End-to-End Training in Deep Unsupervised Contrastive Learning	Feb 17, 2020	Contrastive Learning	—Unverified	0
A Simple Framework for Contrastive Learning of Visual Representations	Feb 13, 2020	Contrastive LearningImage Classification	CodeCode Available	2
On Contrastive Learning for Likelihood-free Inference	Feb 10, 2020	Contrastive Learning	CodeCode Available	1
CURL: Contrastive Unsupervised Representation Learning for Reinforcement Learning	Jan 1, 2020	Contrastive Learningreinforcement-learning	CodeCode Available	1
Understanding Contrastive Representation Learning through Geometry on the Hypersphere	Jan 1, 2020	Contrastive LearningDepth Estimation	CodeCode Available	1
Self-Supervised Learning of Pretext-Invariant Representations	Dec 4, 2019	Contrastive Learningobject-detection	CodeCode Available	1
Contrastive Learning of Structured World Models	Nov 27, 2019	Atari GamesContrastive Learning	CodeCode Available	0
Self-labelling via simultaneous clustering and representation learning	Nov 13, 2019	ClusteringContrastive Learning	CodeCode Available	1
Momentum Contrast for Unsupervised Visual Representation Learning	Nov 13, 2019	Contrastive LearningImage Classification	CodeCode Available	3
Contrastive Multi-document Question Generation	Nov 8, 2019	Contrastive LearningQuestion Generation	CodeCode Available	0
Robust contrastive learning and nonlinear ICA in the presence of outliers	Nov 1, 2019	Causal DiscoveryContrastive Learning	—Unverified	0
Contrastive Representation Distillation	Oct 23, 2019	Contrastive LearningKnowledge Distillation	CodeCode Available	1

Show:10 25 50

← PrevPage 265 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified