Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1351–1375 of 6661 papers

Title	Date	Tasks	Status	Hype	Score
Advancing 3D Medical Image Analysis with Variable Dimension Transform based Supervised 3D Pre-training	Jan 5, 2022	Contrastive LearningMedical Image Analysis	CodeCode Available	1	5
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo	Mar 30, 2022	Contrastive Learning	CodeCode Available	1	5
MedualTime: A Dual-Adapter Language Model for Medical Time Series-Text Multimodal Learning	Jun 7, 2024	Contrastive LearningLanguage Modeling	CodeCode Available	1	5
Contrastive Learning of Generalized Game Representations	Jun 18, 2021	Contrastive LearningImage Classification	CodeCode Available	1	5
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning	Oct 17, 2020	Contrastive LearningRepresentation Learning	CodeCode Available	1	5
Contrastive learning of global and local features for medical image segmentation with limited annotations	Jun 18, 2020	Contrastive LearningData Augmentation	CodeCode Available	1	5
Contrastive Learning of Global-Local Video Representations	Apr 7, 2021	ClassificationContrastive Learning	CodeCode Available	1	5
DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition	Sep 20, 2020	Contrastive LearningDiversity	CodeCode Available	1	5
BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learning	May 26, 2022	Contrastive LearningQuantization	CodeCode Available	1	5
Contrastive Learning of Medical Visual Representations from Paired Images and Text	Oct 2, 2020	Contrastive LearningDescriptive	CodeCode Available	1	5
Contrastive Learning of Musical Representations	Mar 17, 2021	Contrastive LearningLinear evaluation	CodeCode Available	1	5
Dynamic Clustering and Cluster Contrastive Learning for Unsupervised Person Re-identification	Mar 13, 2023	ClusteringComputational Efficiency	CodeCode Available	1	5
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning	Mar 3, 2022	Contrastive LearningFairness	CodeCode Available	1	5
Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration	Dec 12, 2024	Contrastive LearningImage Restoration	CodeCode Available	1	5
Compressive Visual Representations	Sep 27, 2021	Contrastive LearningImage Classification	CodeCode Available	1	5
Mining Gaze for Contrastive Learning toward Computer-Assisted Diagnosis	Dec 11, 2023	Contrastive LearningSemantic Similarity	CodeCode Available	1	5
Deep Image Clustering with Contrastive Learning and Multi-scale Graph Convolutional Networks	Jul 14, 2022	ClusteringContrastive Learning	CodeCode Available	1	5
Image Difference Captioning with Pre-training and Contrastive Learning	Feb 9, 2022	Contrastive LearningFine-Grained Image Classification	CodeCode Available	1	5
An Interactive Multi-modal Query Answering System with Retrieval-Augmented Large Language Models	Jul 5, 2024	Answer GenerationContrastive Learning	CodeCode Available	1	5
DyTed: Disentangled Representation Learning for Discrete-time Dynamic Graph	Oct 19, 2022	Contrastive LearningDisentanglement	CodeCode Available	1	5
Contrastive Mean Teacher for Domain Adaptive Object Detectors	May 4, 2023	Contrastive LearningDomain Adaptation	CodeCode Available	1	5
AutoGCL: Automated Graph Contrastive Learning via Learnable View Generators	Sep 21, 2021	Contrastive LearningGraph Representation Learning	CodeCode Available	1	5
Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learning	Nov 23, 2022	Contrastive LearningData Augmentation	CodeCode Available	1	5
Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization	Dec 30, 2023	Answer GenerationContrastive Learning	CodeCode Available	1	5
Multi-level Feature Learning for Contrastive Multi-view Clustering	Jun 21, 2021	ClusteringContrastive Learning	CodeCode Available	1	5

Show:10 25 50

← PrevPage 55 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified