Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1851–1875 of 6661 papers

Title	Date	Tasks	Status	Hype
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training	Jun 17, 2020	Contrastive LearningGeneral Classification	CodeCode Available	1
Contrastive Learning for Weakly Supervised Phrase Grounding	Jun 17, 2020	Contrastive LearningLanguage Modeling	CodeCode Available	1
Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction	Jun 15, 2020	ClusteringContrastive Learning	CodeCode Available	1
Adversarial Self-Supervised Contrastive Learning	Jun 13, 2020	Adversarial AttackContrastive Learning	CodeCode Available	1
Knowledge Distillation Meets Self-Supervision	Jun 12, 2020	Contrastive LearningKnowledge Distillation	CodeCode Available	1
Quasi-Dense Similarity Learning for Multiple Object Tracking	Jun 11, 2020	Contrastive LearningMetric Learning	CodeCode Available	1
DisCont: Self-Supervised Visual Attribute Disentanglement using Context Vectors	Jun 10, 2020	AttributeContrastive Learning	CodeCode Available	1
Multi-view Contrastive Learning for Online Knowledge Distillation	Jun 7, 2020	ClassificationContrastive Learning	CodeCode Available	1
Deep Graph Contrastive Representation Learning	Jun 7, 2020	AttributeContrastive Learning	CodeCode Available	1
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations	Jun 5, 2020	ClusteringContrastive Learning	CodeCode Available	1
Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID	Jun 4, 2020	ClusteringContrastive Learning	CodeCode Available	1
CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patients	May 27, 2020	Contrastive LearningLinear evaluation	CodeCode Available	1
Network Comparison with Interpretable Contrastive Network Representation Learning	May 25, 2020	Contrastive LearningRepresentation Learning	CodeCode Available	1
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere	May 20, 2020	Contrastive LearningRepresentation Learning	CodeCode Available	1
ViTAA: Visual-Textual Attributes Alignment in Person Search by Natural Language	May 15, 2020	AttributeContrastive Learning	CodeCode Available	1
Prototypical Contrastive Learning of Unsupervised Representations	May 11, 2020	ClusteringContrastive Learning	CodeCode Available	1
Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions	May 4, 2020	Contrastive LearningMulti-Task Learning	CodeCode Available	1
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels	Apr 28, 2020	AllAtari Games 100k	CodeCode Available	1
Audio-Visual Instance Discrimination with Cross-Modal Agreement	Apr 27, 2020	Action RecognitionAudio Classification	CodeCode Available	1
Disentangled and Controllable Face Image Generation via 3D Imitative-Contrastive Learning	Apr 24, 2020	Contrastive LearningDisentanglement	CodeCode Available	1
CURL: Contrastive Unsupervised Representations for Reinforcement Learning	Apr 8, 2020	Atari GamesAtari Games 100k	CodeCode Available	1
Edge Guided GANs with Contrastive Learning for Semantic Image Synthesis	Mar 31, 2020	Contrastive LearningImage Generation	CodeCode Available	1
Improved Baselines with Momentum Contrastive Learning	Mar 9, 2020	Contrastive LearningData Augmentation	CodeCode Available	1
On Compositions of Transformations in Contrastive Self-Supervised Learning	Mar 9, 2020	Action RecognitionAudio Classification	CodeCode Available	1
CoLES: Contrastive Learning for Event Sequences with Self-Supervision	Feb 19, 2020	Contrastive LearningMetric Learning	CodeCode Available	1

Show:10 25 50

← PrevPage 75 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified