Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1501–1525 of 6661 papers

Title	Date	Tasks	Status	Hype
Learning 3D Representations of Molecular Chirality with Invariance to Bond Rotations	Oct 8, 2021	Contrastive LearningData Augmentation	CodeCode Available	1
3D Infomax improves GNNs for Molecular Property Prediction	Oct 8, 2021	Contrastive LearningGraph Learning	CodeCode Available	1
Phone-to-audio alignment without text: A Semi-supervised Approach	Oct 8, 2021	Contrastive Learning	CodeCode Available	1
Temperature as Uncertainty in Contrastive Learning	Oct 8, 2021	Contrastive LearningLinear evaluation	CodeCode Available	1
Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling	Oct 7, 2021	Contrastive Learningslot-filling	CodeCode Available	1
Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data	Oct 7, 2021	Contrastive LearningDomain Adaptation	CodeCode Available	1
The Information Geometry of Unsupervised Reinforcement Learning	Oct 6, 2021	Contrastive Learningreinforcement-learning	CodeCode Available	1
KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier	Oct 6, 2021	Contrastive Learningtext-classification	CodeCode Available	1
ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning	Oct 5, 2021	Contrastive LearningRepresentation Learning	CodeCode Available	1
Consistent Explanations by Contrastive Learning	Oct 1, 2021	Contrastive LearningExplainable artificial intelligence	CodeCode Available	1
CALDA: Improving Multi-Source Time Series Domain Adaptation with Contrastive Adversarial Learning	Sep 30, 2021	Activity RecognitionContrastive Learning	CodeCode Available	1
Motion-aware Contrastive Video Representation Learning via Foreground-background Merging	Sep 30, 2021	Action RecognitionContrastive Learning	CodeCode Available	1
Contrastive Label Disambiguation for Partial Label Learning	Sep 29, 2021	Contrastive LearningPartial Label Learning	CodeCode Available	1
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations	Sep 27, 2021	Contrastive LearningLanguage Modelling	CodeCode Available	1
Compressive Visual Representations	Sep 27, 2021	Contrastive LearningImage Classification	CodeCode Available	1
DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings	Sep 26, 2021	Contrastive LearningSemantic Textual Similarity	CodeCode Available	1
Hard-sample Guided Hybrid Contrast Learning for Unsupervised Person Re-Identification	Sep 25, 2021	Contrastive LearningPerson Re-Identification	CodeCode Available	1
Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation	Sep 25, 2021	Contrastive LearningDescriptive	CodeCode Available	1
GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction	Sep 24, 2021	Contrastive LearningData Augmentation	CodeCode Available	1
DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing	Sep 22, 2021	AttributeContrastive Learning	CodeCode Available	1
AutoGCL: Automated Graph Contrastive Learning via Learnable View Generators	Sep 21, 2021	Contrastive LearningGraph Representation Learning	CodeCode Available	1
On the Importance of Distractors for Few-Shot Classification	Sep 20, 2021	ClassificationContrastive Learning	CodeCode Available	1
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models	Sep 19, 2021	Contextualised Word RepresentationsContrastive Learning	CodeCode Available	1
Pointly-supervised 3D Scene Parsing with Viewpoint Bottleneck	Sep 17, 2021	Contrastive LearningRepresentation Learning	CodeCode Available	1
Self-supervised Contrastive Learning for EEG-based Sleep Staging	Sep 16, 2021	Contrastive LearningEEG	CodeCode Available	1

Show:10 25 50

← PrevPage 61 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified