SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2851–2900 of 5044 papers

TitleStatusHype
Exploring DINO: Emergent Properties and Limitations for Synthetic Aperture Radar Imagery—0
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4—0
Dual Conic Proxies for AC Optimal Power Flow—0
FroSSL: Frobenius Norm Minimization for Efficient Multiview Self-Supervised LearningCode0
MUSCLE: Multi-task Self-supervised Continual Learning to Pre-train Deep Models for X-ray Images of Multiple Body Parts—0
MIMO-NeRF: Fast Neural Rendering with Multi-input Multi-output Neural Radiance Fields—0
Understanding Masked Autoencoders From a Local Contrastive Perspective—0
An Investigation of Representation and Allocation Harms in Contrastive LearningCode0
uSee: Unified Speech Enhancement and Editing with Conditional Diffusion Models—0
Unconstrained Stochastic CCA: Unifying Multiview and Self-Supervised LearningCode0
Self-supervised Learning for Anomaly Detection in Computational Workflows—0
ECG-SL: Electrocardiogram(ECG) Segment Learning, a deep learning method for ECG signal—0
Self-supervised Learning of Contextualized Local Visual EmbeddingsCode0
GhostEncoder: Stealthy Backdoor Attacks with Dynamic Triggers to Pre-trained Encoders in Self-supervised Learning—0
SimLVSeg: Simplifying Left Ventricular Segmentation in 2D+Time Echocardiograms with Self- and Weakly-Supervised LearningCode0
SSHR: Leveraging Self-supervised Hierarchical Representations for Multilingual Automatic Speech Recognition—0
PC-Adapter: Topology-Aware Adapter for Efficient Domain Adaption on Point Clouds with Rectified Pseudo-label—0
Low-Resource Self-Supervised Learning with SSL-Enhanced TTS—0
CtxMIM: Context-Enhanced Masked Image Modeling for Remote Sensing Image Understanding—0
Multi-Granularity Click Confidence Learning via Self-Distillation in Recommendation—0
The Triad of Failure Modes and a Possible Way Out—0
Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study—0
KDD-LOAM: Jointly Learned Keypoint Detector and Descriptors Assisted LiDAR Odometry and Mapping—0
Style Transfer and Self-Supervised Learning Powered Myocardium Infarction Super-Resolution SegmentationCode0
SEPT: Towards Efficient Scene Representation Learning for Motion Prediction—0
M^33D: Learning 3D priors using Multi-Modal Masked Autoencoders for 2D image and video understanding—0
Joint Prediction and Denoising for Large-scale Multilingual Self-supervised Learning—0
Revisiting LARS for Large Batch Training Generalization of Neural Networks—0
On the Impact of Quantization and Pruning of Self-Supervised Speech Models for Downstream Speech Recognition Tasks "In-the-Wild''—0
Masked Image Residual Learning for Scaling Deeper Vision TransformersCode0
PARTICLE: Part Discovery and Contrastive Learning for Fine-grained RecognitionCode0
Understanding Calibration of Deep Neural Networks for Medical Image Classification—0
Masking Improves Contrastive Self-Supervised Learning for ConvNets, and Saliency Tells You WhereCode0
MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic SegmentationCode0
DimCL: Dimensional Contrastive Learning For Improving Self-Supervised Learning—0
A Study of Forward-Forward Algorithm for Self-Supervised Learning—0
Self-supervised learning unveils change in urban housing from street-level imagesCode0
Scalable Label-efficient Footpath Network Generation Using Remote Sensing Data and Self-supervised LearningCode0
Non-Intrusive Speech Intelligibility Prediction for Hearing Aids using Whisper and Metadata—0
RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy—0
Self-supervised TransUNet for Ultrasound regional segmentation of the distal radius in children—0
Self-supervised Multi-view Clustering in Computer Vision: A Survey—0
Improving Speech Inversion Through Self-Supervised Embeddings and Enhanced Tract Variables—0
Understanding the limitations of self-supervised learning for tabular anomaly detection—0
Personalized Food Image Classification: Benchmark Datasets and New Baseline—0
Hierarchical Metadata Information Constrained Self-Supervised Learning for Anomalous Sound Detection Under Domain Shift—0
Hodge-Aware Contrastive Learning—0
Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS—0
Learning Beyond Similarities: Incorporating Dissimilarities between Positive Pairs in Self-Supervised Time Series Learning—0
GelFlow: Self-supervised Learning of Optical Flow for Vision-Based Tactile Sensor Displacement Measurement—0
Show:102550
← PrevPage 58 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified