SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Showing 6170 of 265 papers

TitleStatusHype
METRA: Scalable Unsupervised RL with Metric-Aware AbstractionCode1
Initialization and Regularization of Factorized Neural LayersCode1
OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised LearningCode1
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech RecognitionCode1
Reinforcement Learning with Action-Free Pre-Training from VideosCode1
ELECTRIcity: An Efficient Transformer for Non-Intrusive Load MonitoringCode1
DOBF: A Deobfuscation Pre-Training Objective for Programming LanguagesCode1
DocILE Benchmark for Document Information Localization and ExtractionCode1
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful LearnerCode1
Unsupervised Pre-Training For Data-Efficient Text-to-Speech On Low Resource LanguagesCode1
Show:102550
← PrevPage 7 of 27Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95Unverified
29RDLsAccuracy (%)94Unverified
33 RMDLAccuracy (%)93Unverified
4CNNAccuracy (%)73Unverified
5RMDLAccuracy (%)0.1Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69Unverified
2Sensitivity89.1Unverified
3RMDL 3 RDLsSensitivity0.87Unverified