SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Showing 181190 of 265 papers

TitleStatusHype
A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning0
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR0
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-210
R-LAtte: Attention Module for Visual Control via Reinforcement Learning0
Unsupervised Active Pre-Training for Reinforcement Learning0
Machine Translation Pre-training for Data-to-Text Generation - A Case Study in Czech0
Bi-tuning of Pre-trained Representations0
Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning0
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
Show:102550
← PrevPage 19 of 27Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95Unverified
29RDLsAccuracy (%)94Unverified
33 RMDLAccuracy (%)93Unverified
4CNNAccuracy (%)73Unverified
5RMDLAccuracy (%)0.1Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69Unverified
2Sensitivity89.1Unverified
3RMDL 3 RDLsSensitivity0.87Unverified