SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 4501–4550 of 5044 papers

TitleStatusHype
Intermediate Self-supervised Learning for Machine Translation Quality Estimation—0
Self-Supervised Learning for Pairwise Data Refinement—0
Latent Programmer: Discrete Latent Codes for Program Synthesis—0
Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningCode1
Patch2Self: Denoising Diffusion MRI with Self-Supervised Learning​Code1
VIME: Extending the Success of Self- and Semi-supervised Learning to Tabular DomainCode1
SIR: Self-supervised Image Rectification via Seeing the Same Scene from Multiple Different Lenses—0
A Selective Survey on Versatile Knowledge Distillation Paradigm for Neural Network Models—0
Scaling Down Deep Learning with MNIST-1DCode1
SS-SFDA : Self-Supervised Source-Free Domain Adaptation for Road Segmentation in Hazardous EnvironmentsCode1
Self supervised contrastive learning for digital histopathologyCode1
Task Programming: Learning Data Efficient Behavior RepresentationsCode1
Self-Supervised Time Series Representation Learning by Inter-Intra Relational ReasoningCode1
How Well Do Self-Supervised Models Transfer?Code1
Evaluation of Out-of-Distribution Detection Performance of Self-Supervised Learning in a Controllable Environment—0
Grafit: Learning fine-grained image representations with coarse labels—0
PLAD: Learning to Infer Shape Programs with Pseudo-Labels and Approximate DistributionsCode0
Can Temporal Information Help with Contrastive Self-Supervised Learning?—0
PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation—0
Dissecting Image CropsCode1
Variational Monocular Depth Estimation for Reliability Prediction—0
Boosting Contrastive Self-Supervised Learning with False Negative CancellationCode1
CoMatch: Semi-supervised Learning with Contrastive Graph RegularizationCode1
Run Away From your Teacher: Understanding BYOL by a Novel Self-Supervised Approach—0
Self-Supervised learning with cross-modal transformers for emotion recognition—0
Learning Object-Centric Video Models by Contrasting Sets—0
Classification by Attention: Scene Graph Classification with Prior Knowledge—0
Robot Gaining Accurate Pouring Skills through Self-Supervised Learning and Generalization—0
Node Similarity Preserving Graph Convolutional NetworksCode1
Geography-Aware Self-Supervised LearningCode1
Watch and Learn: Mapping Language and Noisy Real-world Videos with Self-supervisionCode0
Dense Contrastive Learning for Self-Supervised Visual Pre-TrainingCode1
Self-Supervised Physics-Guided Deep Learning Reconstruction For High-Resolution 3D LGE CMR—0
Combining Self-Supervised and Supervised Learning with Noisy Labels—0
Anomaly Detection in Video via Self-Supervised and Multi-Task LearningCode1
Graph-Based Neural Network Models with Multiple Self-Supervised Auxiliary Tasks—0
ActBERT: Learning Global-Local Video-Text RepresentationsCode0
Discriminative, Generative and Self-Supervised Approaches for Target-Agnostic Learning—0
Unsupervised Learning of Dense Visual Representations—0
Graph Neural Networks for Distributed Linear-Quadratic Control—0
A Self-supervised Learning System for Object Detection in Videos Using Random Walks on GraphsCode0
Self-Supervised Out-of-Distribution Detection in Brain CT Scans—0
Robots of the Lost Arc: Self-Supervised Learning to Dynamically Manipulate Fixed-Endpoint Cables—0
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization ProblemCode1
Towards Domain-Agnostic Contrastive Learning—0
Self-Supervised Learning from Contrastive Mixtures for Personalized Speech EnhancementCode0
Self-Supervised Learning for Biological Sample Localization in 3D Tomographic Images—0
Learning a Geometric Representation for Data-Efficient Depth Estimation via Gradient Field and Contrastive LossCode1
Deep Metric Learning with Spherical Embedding—0
Detection of Maternal and Fetal Stress from the Electrocardiogram with Self-Supervised Representation LearningCode0
Show:102550
← PrevPage 91 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified