SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 4401–4450 of 5044 papers

TitleStatusHype
Exponential Moving Average Normalization for Self-supervised and Semi-supervised LearningCode1
Self-supervised pre-training enhances change detection in Sentinel-2 imageryCode1
TCLR: Temporal Contrastive Learning for Video RepresentationCode1
JigsawGAN: Auxiliary Learning for Solving Jigsaw Puzzles with Generative Adversarial Networks—0
UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled DataCode1
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised LearningCode1
Cross-domain few-shot learning with unlabelled data—0
Self-Supervised Representation Learning from Flow Equivariance—0
Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social RecommendationCode2
SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learning—0
Task-driven Self-supervised Bi-channel Networks for Diagnosis of Breast Cancers with Mammography—0
COSMOS: Catching Out-of-Context Misinformation with Self-Supervised LearningCode1
Self-Supervised Learning for Segmentation—0
Label Contrastive Coding based Graph Neural Network for Graph ClassificationCode1
A Multi-Stage Attentive Transfer Learning Framework for Improving COVID-19 Diagnosis—0
Big Self-Supervised Models Advance Medical Image ClassificationCode1
COVID-19 Prognosis via Self-Supervised Representation Learning and Multi-Image PredictionCode1
SEED: Self-supervised Distillation For Visual RepresentationCode1
Estimating Galactic Distances From Images Using Self-supervised Representation Learning—0
Explicit homography estimation improves contrastive self-supervised learning—0
Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy ImagesCode1
CNN-based Ego-Motion Estimation for Fast MAV ManeuversCode1
Self-supervised Visual-LiDAR Odometry with Flip Consistency—0
Iterative weak/self-supervised classification framework for abnormal events detectionCode1
SLIM: Self-Supervised LiDAR Scene Flow and Motion Segmentation—0
SeLFVi: Self-Supervised Light-Field Video Reconstruction From Stereo VideoCode0
Shape Self-Correction for Unsupervised Point Cloud Understanding—0
IntraTomo: Self-Supervised Learning-Based Tomography via Sinogram Synthesis and PredictionCode0
Exploring Geometry-Aware Contrast and Clustering Harmonization for Self-Supervised 3D Object Detection—0
Parallel Detection-and-Segmentation Learning for Weakly Supervised Instance Segmentation—0
Self-Supervised Image Prior Learning With GMM From a Single Noisy ImageCode0
Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic SegmentationCode0
Contrast and Order Representations for Video Self-Supervised Learning—0
Self-Supervised Domain Adaptation for Forgery Localization of JPEG Compressed Images—0
TravelNet: Self-Supervised Physically Plausible Hand Motion Learning From Monocular Color Images—0
Self-Supervised Cryo-Electron Tomography Volumetric Image Restoration From Single Noisy Volume With Sparsity ConstraintCode1
Co2L: Contrastive Continual LearningCode1
Uncertainty-Aware Pseudo Label Refinery for Domain Adaptive Semantic Segmentation—0
Self-Supervised 3D Skeleton Action Representation Learning With Motion Consistency and Continuity—0
A Machine Teaching Framework for Scalable Recognition—0
Self-supervised Temporal Learning—0
Self-Supervised Learning of Compressed Video Representations—0
Self-supervised Disentangled Representation Learning—0
Self-Supervised Continuous Control without Policy Gradient—0
Neural spatio-temporal reasoning with object-centric self-supervised learning—0
IEPT: Instance-Level and Episode-Level Pretext Tasks for Few-Shot LearningCode1
Exploring Balanced Feature Spaces for Representation Learning—0
XLA: A Robust Unsupervised Data Augmentation Framework for Cross-Lingual NLP—0
Self-supervised representation learning via adaptive hard-positive mining—0
Empirical Studies on the Convergence of Feature Spaces in Deep Learning—0
Show:102550
← PrevPage 89 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified