SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 76–100 of 265 papers

TitleStatusHype
ELECTRIcity: An Efficient Transformer for Non-Intrusive Load MonitoringCode1
CATE: Computation-aware Neural Architecture Encoding with TransformersCode1
Unsupervised Pre-Training For Data-Efficient Text-to-Speech On Low Resource LanguagesCode1
Self-Supervised Pre-Training Boosts Semantic Scene Segmentation on LiDAR DataCode0
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
Self-Supervised Modality-Agnostic Pre-Training of Swin TransformersCode0
Self-training and Pre-training are Complementary for Speech RecognitionCode0
Decoupling Exploration and Exploitation for Unsupervised Pre-training with Successor FeaturesCode0
Data-dependent Initializations of Convolutional Neural NetworksCode0
BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task LearningCode0
Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text GenerationCode0
An Analysis of Unsupervised Pre-training in Light of Recent AdvancesCode0
RMDL: Random Multimodel Deep Learning for ClassificationCode0
A Large-Scale Study on Unsupervised Spatiotemporal Representation LearningCode0
Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question AnsweringCode0
PUNR: Pre-training with User Behavior Modeling for News RecommendationCode0
Generalized 3D Self-supervised Learning Framework via Prompted Foreground-Aware Feature ContrastCode0
Post Training in Deep Learning with Last KernelCode0
COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasetsCode0
Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic DataCode0
Pre-train and Learn: Preserve Global Information for Graph Neural NetworksCode0
CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion RecognitionCode0
MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language ModelsCode0
Unsupervised Pre-Training of Image Features on Non-Curated DataCode0
Learning Deep Representations Using Convolutional Auto-encoders with Symmetric Skip ConnectionsCode0
Show:102550
← PrevPage 4 of 11Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified