SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3701–3750 of 5044 papers

TitleStatusHype
Detection of diabetic retinopathy using longitudinal self-supervised learning—0
BinImg2Vec: Augmenting Malware Binary Image Classification with Data2Vec—0
IMG2IMU: Translating Knowledge from Large-Scale Images to IMU Sensing Applications—0
Self-Score: Self-Supervised Learning on Score-Based Models for MRI Reconstruction—0
Feature diversity in self-supervised learning—0
Be Your Own Neighborhood: Detecting Adversarial Example by the Neighborhood Relations Built on Self-Supervised Learning—0
Listen2YourHeart: A Self-Supervised Approach for Detecting Murmur in Heart-Beat Sounds—0
Feature Alignment by Uncertainty and Self-Training for Source-Free Unsupervised Domain Adaptation—0
A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning—0
Compound Figure Separation of Biomedical Images: Mining Large Datasets for Self-supervised LearningCode0
Stabilize, Decompose, and Denoise: Self-Supervised Fluoroscopy Denoising—0
SB-SSL: Slice-Based Self-Supervised Transformers for Knee Abnormality Classification from MRI—0
Self-Supervised Human Activity Recognition with Localized Time-Frequency Contrastive Representation Learning—0
Effectiveness of Mining Audio and Text Pairs from Public Data for Improving ASR Systems for Low-Resource Languages—0
Clustering Egocentric Images in Passive Dietary Monitoring with Self-Supervised Learning—0
Bidirectional Contrastive Split Learning for Visual Question Answering—0
Federated Self-Supervised Contrastive Learning and Masked Autoencoder for Dermatological Disease Diagnosis—0
PIFu for the Real World: A Self-supervised Framework to Reconstruct Dressed Human from Single-view Images—0
Efficient Self-Supervision using Patch-based Contrastive Learning for Histopathology Image SegmentationCode0
Spiral Contrastive Learning: An Efficient 3D Representation Learning Method for Unannotated CT Lesions—0
IMPaSh: A Novel Domain-shift Resistant Representation for Colorectal Cancer Tissue ClassificationCode0
Transfer Learning Application of Self-supervised Learning in ARPES—0
Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles—0
Semantic-Enhanced Image Clustering—0
Generalised Co-Salient Object Detection—0
Test-time Training for Data-efficient UCDRCode0
Forecasting Evolution of Clusters in Game Agents with Hebbian Learning—0
Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis—0
Siamese Prototypical Contrastive Learning—0
Data Augmentation is a Hyperparameter: Cherry-picked Self-Supervision for Unsupervised Anomaly Detection is Creating the Illusion of SuccessCode0
Matching Multiple Perspectives for Efficient Representation Learning—0
Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognition—0
C3-DINO: Joint Contrastive and Non-contrastive Self-Supervised Learning for Speaker Verification—0
Contrastive Counterfactual Learning for Causality-aware Interpretable Recommender Systems—0
Enhancing Graph Contrastive Learning with Node Similarity—0
Simulating Personal Food Consumption Patterns using a Modified Markov Chain—0
Instance Image Retrieval by Learning Purely From Within the Dataset—0
CCRL: Contrastive Cell Representation LearningCode0
Contrastive Learning for Object DetectionCode0
Contrastive Learning for OOD in Object detectionCode0
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning—0
Non-Contrastive Self-supervised Learning for Utterance-Level Information Extraction from Speech—0
SIAD: Self-supervised Image Anomaly Detection System—0
Stain-Adaptive Self-Supervised Learning for Histopathology Image Analysis—0
Self-Supervised Contrastive Representation Learning for 3D Mesh Segmentation—0
AWEncoder: Adversarial Watermarking Pre-trained Encoders in Contrastive Learning—0
SLiDE: Self-supervised LiDAR De-snowing through Reconstruction Difficulty—0
Cross-Skeleton Interaction Graph Aggregation Network for Representation Learning of Mouse Social BehaviourCode0
Distributed Contrastive Learning for Medical Image Segmentation—0
SSDPT: Self-Supervised Dual-Path Transformer for Anomalous Sound Detection in Machine Condition Monitoring—0
Show:102550
← PrevPage 75 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified