SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Showing 50015044 of 5044 papers

TitleStatusHype
Self-Supervised Learning of Depth and Camera Motion from 360° Videos0
Cross and Learn: Cross-Modal Self-SupervisionCode0
Textbook Question Answering with Multi-modal Context Graph Understanding and Self-supervised Open-set Comprehension0
Improving label efficiency through multi-task learning on auditory data0
AIRNet: Self-Supervised Affine Registration for 3D Medical Images using Neural Networks0
Improving Sentence Representations with Consensus Maximisation0
Meta-Embedding as Auxiliary Task Regularization0
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition0
Improving Spatiotemporal Self-Supervision by Deep Reinforcement Learning0
Cross Pixel Optical Flow Similarity for Self-Supervised Learning0
TextTopicNet - Self-Supervised Learning of Visual Features Through Embedding Images on Semantic Text SpacesCode0
Self-supervised Learning for Dense Depth Estimation in Monocular Endoscopy0
The Sparse Manifold Transform0
Temporal coherence-based self-supervised learning for laparoscopic workflow analysisCode0
Two Stream Self-Supervised Learning for Action Recognition0
Self-Supervised Feature Learning by Learning to Spot Artifacts0
Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning0
Boosting Self-Supervised Learning via Knowledge Transfer0
Better and Faster: Knowledge Transfer from Multiple Self-supervised Learning Tasks via Graph Distillation for Video Classification0
Self-supervised Learning of Geometrically Stable Features Through Probabilistic Introspection0
Fusion of stereo and still monocular depth estimates in a self-supervised learning context0
Reblur2Deblur: Deblurring Videos via Self-Supervised Learning0
Non-Rigid Image Registration Using Self-Supervised Fully Convolutional Networks without Training Data0
Self-Supervised Learning of Object Motion Through Adversarial Video Prediction0
Self-supervised Learning of Motion CaptureCode0
Exploiting the potential of unlabeled endoscopic video data with self-supervised learning0
Improvements to context based self-supervised learning0
Self-supervised learning: When is fusion of the primary and secondary sensor cue useful?0
Generating Music Medleys via Playing Music Puzzle Games0
Self-Supervised Learning for Stereo Matching with Self-Improving Ability0
Transitive Invariance for Self-supervised Visual Representation Learning0
Weakly- and Self-Supervised Learning for Content-Aware Deep Image RetargetingCode0
Self-supervised Learning of Pose Embeddings from Spatiotemporal Relations in Videos0
CASSL: Curriculum Accelerated Self-Supervised Learning0
Self-Supervised Learning for Spinal MRIs0
LSTM Self-Supervision for Detailed Behavior Analysis0
Towards Visual Ego-motion Learning in Robots0
Self-supervised learning of visual features through embedding images into text topic spaces0
Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human ParsingCode0
A Self-supervised Learning System for Object Detection using Physics Simulation and Multi-view Pose EstimationCode0
Combining Self-Supervised Learning and Imitation for Vision-Based Rope Manipulation0
Diverse Sampling for Self-Supervised Learning of Semantic Segmentation0
Self-Supervised Video Representation Learning With Odd-One-Out Networks0
Wikipedia Edit Number Prediction based on Temporal Dynamics OnlyCode0
Show:102550
← PrevPage 101 of 101Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5Unverified
2Pretraining: ShEDImages & Text54.3Unverified
3Pretraining: e-MixImages & Text48.9Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7Unverified
2ResNet18Accuracy91.02Unverified
3MV-MRAccuracy89.67Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89Unverified
2ResNet18average top-1 classification accuracy92.58Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51Unverified
2ResNet18average top-1 classification accuracy69.31Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84Unverified
2ResNet18average top-1 classification accuracy51.67Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86Unverified