SOTAVerified

Self-Supervised Learning

Self-Supervised Learning is proposed for utilizing unlabeled data with the success of supervised learning. Producing a dataset with good labels is expensive, while unlabeled data is being generated all the time. The motivation of Self-Supervised Learning is to make use of the large amount of unlabeled data. The main idea of Self-Supervised Learning is to generate the labels from unlabeled data, according to the structure or characteristics of the data itself, and then train on this unsupervised data in a supervised manner. Self-Supervised Learning is wildly used in representation learning to make a model learn the latent features of the data. This technique is often employed in computer vision, video processing and robot control.

Source: Self-supervised Point Set Local Descriptors for Point Cloud Registration

Image source: LeCun

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 3801–3850 of 5044 papers

TitleStatusHype
How Well Does Self-Supervised Pre-Training Perform with Streaming Data?—0
How You Move Your Head Tells What You Do: Self-supervised Video Representation Learning with Egocentric Cameras and IMU Sensors—0
Human Activity Recognition on wrist-worn accelerometers using self-supervised neural networks—0
Human Gaze Boosts Object-Centered Representation Learning—0
Human-Timescale Adaptation in an Open-Ended Task Space—0
Hybrid BYOL-ViT: Efficient approach to deal with small datasets—0
Hybrid Deep Learning and Signal Processing for Arabic Dialect Recognition in Low-Resource Settings—0
Hybrid Interest Modeling for Long-tailed Users—0
Hybrid Learning: A Novel Combination of Self-Supervised and Supervised Learning for MRI Reconstruction without High-Quality Training Reference—0
Hybrid Transformer and Spatial-Temporal Self-Supervised Learning for Long-term Traffic Prediction—0
Hyperbolic Contrastive Learning—0
HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detection—0
Hyperspectral Anomaly Detection with Self-Supervised Anomaly Prior—0
Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques—0
Hyperspherically Regularized Networks for Self-Supervision—0
iBoot: Image-bootstrapped Self-Supervised Video Representation Learning—0
Identifying Critical Tokens for Accurate Predictions in Transformer-based Medical Imaging Models—0
Identifying Terrain Physical Parameters from Vision -- Towards Physical-Parameter-Aware Locomotion and Navigation—0
Identity-Disentangled Adversarial Augmentation for Self-supervised Learning—0
Image-based Freeform Handwriting Authentication with Energy-oriented Self-Supervised Learning—0
Image-Based Vehicle Classification by Synergizing Features from Supervised and Self-Supervised Learning Paradigms—0
Image Classification Using a Diffusion Model as a Pre-Training Model—0
Image Coding for Machines with Omnipotent Feature Learning—0
Image Compression with Product Quantized Masked Image Modeling—0
Image Generation and Learning Strategy for Deep Document Forgery Detection—0
Image as First-Order Norm+Linear Autoregression: Unveiling Mathematical Invariance—0
Imaging with Equivariant Deep Learning—0
Imbalance-Aware Self-Supervised Learning for 3D Radiomic Representations—0
IMG2IMU: Translating Knowledge from Large-Scale Images to IMU Sensing Applications—0
Impact Analysis of the Use of Speech and Language Models Pretrained by Self-Supersivion for Spoken Language Understanding—0
Impact of Language Guidance: A Reproducibility Study—0
IMPA-HGAE:Intra-Meta-Path Augmented Heterogeneous Graph Autoencoder—0
Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view—0
Imposing Consistency for Optical Flow Estimation—0
Improved baselines for vision-language pre-training—0
Improved Cross-Lingual Transfer Learning For Automatic Speech Translation—0
Improved Intelligibility of Dysarthric Speech using Conditional Flow Matching—0
Improved Language Identification Through Cross-Lingual Self-Supervised Learning—0
Improved Simultaneous Multi-Slice Functional MRI Using Self-supervised Deep Learning—0
Improved skin lesion recognition by a Self-Supervised Curricular Deep Learning approach—0
Improved Speech Pre-Training with Supervision-Enhanced Acoustic Unit—0
Improvements to context based self-supervised learning—0
Improving Accented Speech Recognition using Data Augmentation based on Unsupervised Text-to-Speech Synthesis—0
Improving Accented Speech Recognition with Multi-Domain Training—0
Improving Accent Identification and Accented Speech Recognition Under a Framework of Self-supervised Learning—0
Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning—0
Improving Cross-Lingual Phonetic Representation of Low-Resource Languages Through Language Similarity Analysis—0
Towards domain-invariant Self-Supervised Learning with Batch Styles Standardization—0
Improving Graph Contrastive Learning via Adaptive Positive Sampling—0
Improving label efficiency through multi-task learning on auditory data—0
Show:102550
← PrevPage 77 of 101Next →
All datasetsDABSSTL-10CIFAR10cifar100ImageNet-100 (TEMI Split)TinyImageNetCIFAR-10CIFAR-100CREMA-DTiny ImageNet

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Pretraining: NoneImages & Text57.5—Unverified
2Pretraining: ShEDImages & Text54.3—Unverified
3Pretraining: e-MixImages & Text48.9—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50Accuracy91.7—Unverified
2ResNet18Accuracy91.02—Unverified
3MV-MRAccuracy89.67—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy93.89—Unverified
2ResNet18average top-1 classification accuracy92.58—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy72.51—Unverified
2ResNet18average top-1 classification accuracy69.31—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy82.64—Unverified
2CorInfomax (ResNet18)Top-1 Accuracy80.48—Unverified
#ModelMetricClaimedVerifiedStatus
1ResNet50average top-1 classification accuracy51.84—Unverified
2ResNet18average top-1 classification accuracy51.67—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy93.18—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet18)Top-1 Accuracy71.61—Unverified
#ModelMetricClaimedVerifiedStatus
1Hybrid BYOL-S/CvTAccuracy67.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CorInfomax (ResNet50)Top-1 Accuracy54.86—Unverified