Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 5476–5500 of 6661 papers

Title	Date	Tasks	Status	Hype
DistilCSE: Effective Knowledge Distillation For Contrastive Sentence Embeddings	Dec 10, 2021	Contrastive LearningKnowledge Distillation	CodeCode Available	1
Dual Cluster Contrastive learning for Object Re-Identification	Dec 9, 2021	Contrastive LearningObject	CodeCode Available	0
SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual Representations	Dec 9, 2021	Contrastive LearningUnsupervised Pre-training	CodeCode Available	1
Contextualized Spatio-Temporal Contrastive Learning with Self-Supervision	Dec 9, 2021	Action LocalizationAction Recognition	CodeCode Available	0
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework	Dec 9, 2021	Contrastive LearningLinear evaluation	CodeCode Available	1
From Good to Best: Two-Stage Training for Cross-lingual Machine Reading Comprehension	Dec 9, 2021	Contrastive LearningMachine Reading Comprehension	—Unverified	0
KGE-CL: Contrastive Learning of Tensor Decomposition Based Knowledge Graph Embeddings	Dec 9, 2021	Contrastive LearningGraph Embedding	CodeCode Available	1
Boosting Contrastive Learning with Relation Knowledge Distillation	Dec 8, 2021	Contrastive LearningKnowledge Distillation	—Unverified	0
Contrastive Instruction-Trajectory Learning for Vision-Language Navigation	Dec 8, 2021	Contrastive LearningNavigate	CodeCode Available	0
Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularization	Dec 8, 2021	Contrastive LearningData Augmentation	—Unverified	0
Revisiting Contrastive Learning through the Lens of Neighborhood Component Analysis: an Integrated Framework	Dec 8, 2021	Contrastive LearningRepresentation Learning	—Unverified	0
Contrastive Learning with Large Memory Bank and Negative Embedding Subtraction for Accurate Copy Detection	Dec 8, 2021	Contrastive LearningCopy Detection	CodeCode Available	1
TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learning	Dec 7, 2021	Action RecognitionContrastive Learning	CodeCode Available	1
Contrastive Learning from Extremely Augmented Skeleton Sequences for Self-supervised Action Recognition	Dec 7, 2021	Action RecognitionContrastive Learning	CodeCode Available	1
Suppressing Static Visual Cues via Normalizing Flows for Self-Supervised Video Representation Learning	Dec 7, 2021	Contrastive LearningRepresentation Learning	CodeCode Available	0
Time-Equivariant Contrastive Video Representation Learning	Dec 7, 2021	Action RecognitionContrastive Learning	—Unverified	0
Seeing Objects in dark with Continual Contrastive Learning	Dec 6, 2021	Continual LearningContrastive Learning	—Unverified	0
Separated Contrastive Learning for Organ-at-Risk and Gross-Tumor-Volume Segmentation with Limited Annotation	Dec 6, 2021	Contrastive Learning	CodeCode Available	1
4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding	Dec 6, 2021	3D Instance Segmentation3D Semantic Segmentation	—Unverified	0
Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learning	Dec 6, 2021	Anomaly DetectionContrastive Learning	CodeCode Available	1
Joint Learning of Localized Representations from Medical Images and Reports	Dec 6, 2021	Contrastive Learningimage-classification	CodeCode Available	1
VarCLR: Variable Semantic Representation Pre-training via Contrastive Learning	Dec 5, 2021	Contrastive LearningLearning Semantic Representations	CodeCode Available	1
CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks	Dec 5, 2021	ClassificationContinual Learning	—Unverified	0
U2-Former: A Nested U-shaped Transformer for Image Restoration	Dec 4, 2021	Computational EfficiencyContrastive Learning	—Unverified	0
Transferring Unconditional to Conditional GANs with Hyper-Modulation	Dec 4, 2021	Conditional Image GenerationContrastive Learning	CodeCode Available	1

Show:10 25 50

← PrevPage 220 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified