Contrastive Learning

Contrastive Learning is a deep learning technique for unsupervised representation learning. The goal is to learn a representation of data such that similar instances are close together in the representation space, while dissimilar instances are far apart.

It has been shown to be effective in various computer vision and natural language processing tasks, including image retrieval, zero-shot learning, and cross-modal retrieval. In these tasks, the learned representations can be used as features for downstream tasks such as classification and clustering.

(Image credit: Schroff et al. 2015)

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1251–1275 of 6661 papers

Title	Date	Tasks	Status	Hype
New Intent Discovery with Pre-training and Contrastive Learning	May 25, 2022	ClusteringContrastive Learning	CodeCode Available	1
Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer	May 20, 2022	Contrastive LearningRepresentation Learning	CodeCode Available	1
Contrastive Learning with Cross-Modal Knowledge Mining for Multimodal Human Activity Recognition	May 20, 2022	Activity RecognitionContrastive Learning	CodeCode Available	1
A graph-transformer for whole slide image classification	May 19, 2022	ClassificationContrastive Learning	CodeCode Available	1
A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extraction	May 19, 2022	Contrastive LearningRelation	CodeCode Available	1
Free Lunch for Surgical Video Understanding by Distilling Self-Supervisions	May 19, 2022	Contrastive LearningSelf-Supervised Learning	CodeCode Available	1
Masked Image Modeling with Denoising Contrast	May 19, 2022	Contrastive LearningDenoising	CodeCode Available	1
RankGen: Improving Text Generation with Large Ranking Models	May 19, 2022	Contrastive LearningLanguage Modeling	CodeCode Available	1
Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learning	May 19, 2022	Contrastive LearningImage Stylization	CodeCode Available	1
FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization	May 16, 2022	Abstractive Text SummarizationContrastive Learning	CodeCode Available	1
Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization	May 15, 2022	Contrastive LearningIntent Detection	CodeCode Available	1
Near out-of-distribution detection for low-resolution radar micro-Doppler signatures	May 12, 2022	Contrastive LearningGeometry-aware processing	CodeCode Available	1
Multiplexed Immunofluorescence Brain Image Analysis Using Self-Supervised Dual-Loss Adaptive Masked Autoencoder	May 10, 2022	Cell DetectionContrastive Learning	CodeCode Available	1
Learning Non-target Knowledge for Few-shot Semantic Segmentation	May 10, 2022	Contrastive LearningFew-Shot Semantic Segmentation	CodeCode Available	1
EASE: Entity-Aware Contrastive Learning of Sentence Embedding	May 9, 2022	ClusteringContrastive Learning	CodeCode Available	1
Cross-modal Contrastive Learning for Speech Translation	May 5, 2022	Contrastive LearningRetrieval	CodeCode Available	1
A Simple Contrastive Learning Objective for Alleviating Neural Text Degeneration	May 5, 2022	Contrastive LearningDialogue Generation	CodeCode Available	1
UCL-Dehaze: Towards Real-world Image Dehazing via Unsupervised Contrastive Learning	May 4, 2022	Contrastive LearningImage Dehazing	CodeCode Available	1
HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction	May 4, 2022	ClusteringContrastive Learning	CodeCode Available	1
Contrastive Learning for Prompt-Based Few-Shot Language Learners	May 3, 2022	Contrastive LearningIn-Context Learning	CodeCode Available	1
Debiased Contrastive Learning of Unsupervised Sentence Representations	May 2, 2022	Contrastive LearningSemantic Textual Similarity	CodeCode Available	1
Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding	May 2, 2022	Contrastive LearningSpoken Language Understanding	CodeCode Available	1
Knowledge Graph Contrastive Learning for Recommendation	May 2, 2022	Contrastive LearningGeneral Knowledge	CodeCode Available	1
Imputing Out-of-Vocabulary Embeddings with LOVE Makes LanguageModels Robust with Little Cost	May 1, 2022	Contrastive LearningLanguage Modeling	CodeCode Available	1
Disentangled Knowledge Transfer for OOD Intent Discovery with Unified Contrastive Learning	May 1, 2022	ClusteringContrastive Learning	CodeCode Available	1

Show:10 25 50

← PrevPage 51 of 267Next →

All datasets imagenet-1k 10,000 People - Human Pose Recognition Data CIFAR-10 STL-10

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ResNet50	ImageNet Top-1 Accuracy	73.6	—	Unverified
2	ResNet50	ImageNet Top-1 Accuracy	73	—	Unverified
3	ResNet50	ImageNet Top-1 Accuracy	71.1	—	Unverified
4	ResNet50	ImageNet Top-1 Accuracy	69.3	—	Unverified
5	ResNet50 (v2)	ImageNet Top-1 Accuracy	67.6	—	Unverified
6	ResNet50 (v2)	ImageNet Top-1 Accuracy	63.8	—	Unverified
7	ResNet50	ImageNet Top-1 Accuracy	63.6	—	Unverified
8	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
9	ResNet50	ImageNet Top-1 Accuracy	61.5	—	Unverified
10	ResNet50 (4×)	ImageNet Top-1 Accuracy	61.3	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	1	0..5sec	1	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	84.77	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	IPCL (ResNet18)	Accuracy (Top-1)	85.55	—	Unverified