SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–125 of 265 papers

TitleStatusHype
Convergence of gradient based pre-training in Denoising autoencoders—0
Leveraging Random Label Memorization for Unsupervised Pre-Training—0
GFlowNet Pretraining with Inexpensive Rewards—0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning—0
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method—0
Cross-Domain Training for Goal-Oriented Conversational Agents—0
Foundation Model for Wireless Technology Recognition Using IQ Timeseries—0
On Architectures and Training for Raw Waveform Feature Extraction in ASR—0
Faster learning of deep stacked autoencoders on multi-core systems using synchronized layer-wise pre-training—0
Author2Vec: A Framework for Generating User Embedding—0
Lottery Hypothesis based Unsupervised Pre-training for Model Compression in Federated Learning—0
Measles Rash Identification Using Residual Deep Convolutional Neural Network—0
On the Generalization Ability of Unsupervised Pretraining—0
FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs—0
Generalized 3D Self-supervised Learning Framework via Prompted Foreground-Aware Feature Contrast—0
Incomplete Multi-View Multi-label Learning via Disentangled Representation and Label Semantic Embedding—0
Co-Morbidity Exploration on Wearables Activity Data Using Unsupervised Pre-training and Multi-Task Learning—0
Extractive NarrativeQA with Heuristic Pre-Training—0
Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models—0
Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback—0
Deep Discriminative Model for Video Classification—0
Combining Unsupervised Pre-training and Annotator Rationales to Improve Low-shot Text Classification—0
Audio Transformers—0
Large Language Model Enabled Semantic Communication Systems—0
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts—0
Show:102550
← PrevPage 5 of 11Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified