SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Showing 211220 of 265 papers

TitleStatusHype
Extractive NarrativeQA with Heuristic Pre-Training0
Unsupervised pre-training for sequence to sequence speech recognition0
Pre-train and Learn: Preserve Global Information for Graph Neural NetworksCode0
Improving Transformer-based Speech Recognition Using Unsupervised Pre-trainingCode1
Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models0
SMiRL: Surprise Minimizing RL in Entropic Environments0
Understanding Semantics from Speech Through Pre-training0
Bridging the domain gap in cross-lingual document classificationCode0
Effective training of deep convolutional neural networks for hyperspectral image classification through artificial labeling0
Cross-Domain Training for Goal-Oriented Conversational Agents0
Show:102550
← PrevPage 22 of 27Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95Unverified
29RDLsAccuracy (%)94Unverified
33 RMDLAccuracy (%)93Unverified
4CNNAccuracy (%)73Unverified
5RMDLAccuracy (%)0.1Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69Unverified
2Sensitivity89.1Unverified
3RMDL 3 RDLsSensitivity0.87Unverified