SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3101–3150 of 5044 papers

TitleStatusHype
Semantic-Aware Fine-Grained CorrespondenceCode1
MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of BehaviorCode0
End-to-End and Self-Supervised Learning for ComParE 2022 Stuttering Sub-Challenge—0
What Do We Maximize in Self-Supervised Learning?—0
GOCA: Guided Online Cluster Assignment for Self-Supervised Video Representation LearningCode0
Video Anomaly Detection by Solving Decoupled Spatio-Temporal Jigsaw PuzzlesCode1
Transfer Learning of wav2vec 2.0 for Automatic Lyric TranscriptionCode1
BYEL : Bootstrap Your Emotion LatentCode0
HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detection—0
A-SFS: Semi-supervised Feature Selection based on Multi-task Self-supervision—0
ExAgt: Expert-guided Augmentation for Representation Learning of Traffic ScenariosCode0
Self-Supervised-RCNN for Medical Image Segmentation with Limited Data Annotation—0
TSPipe: Learn from Teacher Faster with PipelinesCode0
Learning from Temporal Spatial Cubism for Cross-Dataset Skeleton-based Action RecognitionCode0
Federated Self-Supervised Learning in Heterogeneous Settings: Limits of a Baseline Approach on HAR—0
Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial PatchesCode1
Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis—0
On the Importance of Hyperparameters and Data Augmentation for Self-Supervised Learning—0
SSMTL++: Revisiting Self-Supervised Multi-Task Learning for Video Anomaly Detection—0
Masked Spatial-Spectral Autoencoders Are Excellent Hyperspectral Defenders—0
Model-Aware Contrastive Learning: Towards Escaping the DilemmasCode0
HOME: High-Order Mixed-Moment-based Embedding for Representation Learning—0
Benchmarking Omni-Vision Representation through the Lens of Visual RealmsCode1
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models—0
ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology ImagesCode1
Attribute Graphs Underlying Molecular Generative Models: Path to Learning with Limited Data—0
Unsupervised Hebbian Learning on Point Sets in StarCraft II—0
DSPNet: Towards Slimmable Pretrained Networks based on Discriminative Self-supervised Learning—0
Synergistic Self-supervised and Quantization LearningCode1
Label-Efficient Self-Supervised Speaker Verification With Information Maximization and Contrastive Learning—0
Patch-level instance-group discrimination with pretext-invariant learning for colitis scoring—0
Online Continual Learning of End-to-End Speech Recognition Models—0
A clinically motivated self-supervised approach for content-based image retrieval of CT liver imagesCode1
Consistency is the key to further mitigating catastrophic forgetting in continual learningCode0
Towards Proper Contrastive Self-supervised Learning Strategies For Music Audio RepresentationCode1
Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation—0
Invisible Backdoor Attacks Using Data Poisoning in the Frequency Domain—0
Sudowoodo: Contrastive Self-supervised Learning for Multi-purpose Data Integration and PreparationCode1
Pixel-level Correspondence for Self-Supervised Learning from Video—0
Tandem Multitask Training of Speaker Diarisation and Speech Recognition for Meeting Transcription—0
An Embedding-Dynamic Approach to Self-supervised Learning—0
Vision Transformers: State of the Art and Research Challenges—0
Learning Music-Dance Representations through Explicit-Implicit Rhythm Synchronization—0
Self-Supervised RF Signal Representation Learning for NextG Signal Classification with Deep Learning—0
Uncertainty-Aware Self-supervised Neural Network for Liver T_1ρ Mapping with Relaxation Constraint—0
Masked Surfel Prediction for Self-Supervised Point Cloud LearningCode1
Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa—0
Learning Invariant World State Representations with Predictive Coding—0
Histopathology DatasetGAN: Synthesizing Large-Resolution Histopathology DatasetsCode0
Context-aware Self-supervised Learning for Medical Images Using Graph Neural Network—0
Show:102550
← PrevPage 63 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified