SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 4151–4200 of 5044 papers

TitleStatusHype
Interpretable agent communication from scratch (with a generic visual processor emerging on the side)—0
Socially-Aware Self-Supervised Tri-Training for RecommendationCode2
On the Coupling of Depth and Egomotion Networks for Self-Supervised Structure from MotionCode1
Source-Free Open Compound Domain Adaptation in Semantic SegmentationCode1
Mean-Shifted Contrastive Loss for Anomaly DetectionCode1
Incremental False Negative Detection for Contrastive Learning—0
Self-Supervision is All You Need for Solving Rubik's CubeCode1
Understand and Improve Contrastive Learning Methods for Visual Representation: A Review—0
Integrating Auxiliary Information in Self-supervised Learning—0
Conditional Contrastive Learning for Improving Fairness in Self-Supervised Learning—0
ZeroWaste Dataset: Towards Deformable Object Segmentation in Cluttered Scenes—0
Self-Supervised Learning of Domain Invariant Features for Depth Estimation—0
Graph Barlow Twins: A self-supervised representation learning framework for graphsCode1
Self-supervised Dialogue Learning for Spoken Conversational Question Answering—0
TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data—0
NODE-GAM: Neural Generalized Additive Model for Interpretable Deep LearningCode1
Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networks—0
You Never Cluster Alone—0
Container: Context Aggregation NetworkCode1
OctoPath: An OcTree Based Self-Supervised Learning Approach to Local Trajectory Planning for Mobile Robots—0
Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis—0
Adversarial Self-Supervised Learning for Out-of-Domain DetectionCode0
Exploring the Diversity and Invariance in Yourself for Visual Pre-Training Task—0
Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning—0
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning—0
Orienting Novel 3D Objects Using Self-Supervised Learning of Rotation Transforms—0
SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentation—0
About Explicit Variance Minimization: Training Neural Networks for Medical Imaging With Limited Data AnnotationsCode0
Encoders and Ensembles for Task-Free Continual Learning—0
Self-Supervised Bug Detection and RepairCode1
Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Models—0
Sli2Vol: Annotate a 3D Volume from a Single Slice with Self-Supervised LearningCode1
Self-Supervised Graph Representation Learning via Topology TransformationsCode0
GraphVICRegHSIC: Towards improved self-supervised representation learning for graphs with a hyrbid loss functionCode0
A self-supervised learning strategy for postoperative brain cavity segmentation simulating resectionsCode1
FCCDN: Feature Constraint Network for VHR Image Change DetectionCode1
Leveraging SE(3) Equivariance for Self-supervised Category-Level Object Pose Estimation from Point Clouds—0
Backdoor Attacks on Self-Supervised LearningCode1
Masked Contrastive Learning for Anomaly DetectionCode1
Self-Supervised Learning for Fine-Grained Visual CategorizationCode1
Self-Point-Flow: Self-Supervised Scene Flow Estimation from Point Clouds with Optimal Transport and Random Walk—0
Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classification—0
Divide and Contrast: Self-supervised Learning from Uncurated Data—0
Unsupervised Deep Learning Methods for Biological Image Reconstruction and Enhancement—0
Self-supervised Learning on Graphs: Contrastive, Generative,or PredictiveCode2
Semi-supervised Contrastive Learning with Similarity Co-calibration—0
Mean Shift for Self-Supervised LearningCode1
Window-Level is a Strong Denoising SurrogateCode1
Semi-supervised Learning for Identifying the Likelihood of Agitation in People with DementiaCode0
Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentation—0
Show:102550
← PrevPage 84 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified