SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 176–200 of 265 papers

TitleStatusHype
SYNFIX: Automatically Fixing Syntax Errors using Compiler Diagnostics—0
Representation Learning for Weakly Supervised Relation Extraction—0
On Architectures and Training for Raw Waveform Feature Extraction in ASR—0
Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models—0
Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors—0
A Brief Summary of Interactions Between Meta-Learning and Self-Supervised Learning—0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning—0
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR—0
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21—0
R-LAtte: Attention Module for Visual Control via Reinforcement Learning—0
Unsupervised Active Pre-Training for Reinforcement Learning—0
Machine Translation Pre-training for Data-to-Text Generation - A Case Study in Czech—0
Bi-tuning of Pre-trained Representations—0
Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning—0
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
Pre-training Graph Transformer with Multimodal Side Information for Recommendation—0
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method—0
Self-training and Pre-training are Complementary for Speech RecognitionCode0
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring—0
Unsupervised Pre-training for Biomedical Question Answering—0
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model—0
m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural NetworksCode0
Unsupervised Learning For Sequence-to-sequence Text-to-speech For Low-resource Languages—0
Functional Regularization for Representation Learning: A Unified Theoretical PerspectiveCode0
Weakly Supervised Construction of ASR Systems with Massive Video Data—0
Show:102550
← PrevPage 8 of 11Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified