SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 265 papers

TitleStatusHype
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21—0
Attention-Guided Masked Autoencoders For Learning Image Representations—0
Audio Transformers—0
Author2Vec: A Framework for Generating User Embedding—0
Automated clinical coding using off-the-shelf large language models—0
Automatic Sexism Detection with Multilingual Transformer Models—0
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR—0
BID: Boundary-Interior Decoding for Unsupervised Temporal Action Localization Pre-Trainin—0
Bi-tuning of Pre-trained Representations—0
Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Prompt—0
Boundary-aware Information Maximization for Self-supervised Medical Image Segmentation—0
CLAP: Unsupervised 3D Representation Learning for Fusion 3D Perception via Curvature Sampling and Prototype Learning—0
Classifying Whole Slide Images: What Matters?—0
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion—0
Color Constancy Convolutional Autoencoder—0
Combining Unsupervised Pre-training and Annotator Rationales to Improve Low-shot Text Classification—0
Co-Morbidity Exploration on Wearables Activity Data Using Unsupervised Pre-training and Multi-Task Learning—0
Convergence of gradient based pre-training in Denoising autoencoders—0
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring—0
Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learning—0
Cross-Domain Training for Goal-Oriented Conversational Agents—0
CUPre: Cross-domain Unsupervised Pre-training for Few-Shot Cell Segmentation—0
Deep Belief Networks Based Feature Generation and Regression for Predicting Wind Power—0
Deep Discriminative Model for Video Classification—0
Deep Features for CBIR with Scarce Data using Hebbian Learning—0
Device Tuning for Multi-Task Large Model—0
Discovery of Visual Semantics by Unsupervised and Self-Supervised Representation Learning—0
DiscrimNet: Semi-Supervised Action Recognition from Videos using Generative Adversarial Networks—0
Disentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction—0
DPER: Diffusion Prior Driven Neural Representation for Limited Angle and Sparse View CT Reconstruction—0
Differentially Private Optimization for Non-Decomposable Objective Functions—0
ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning—0
Effective training of deep convolutional neural networks for hyperspectral image classification through artificial labeling—0
Empirical Evaluation of Active Learning Techniques for Neural MT—0
Enhance Visual Recognition under Adverse Conditions via Deep Networks—0
Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training—0
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model—0
EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Model—0
Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning—0
Examining the Effect of Pre-training on Time Series Classification—0
Exploiting Unsupervised Pre-training and Automated Feature Engineering for Low-resource Hate Speech Detection in Polish—0
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts—0
Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models—0
Extractive NarrativeQA with Heuristic Pre-Training—0
FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs—0
Faster learning of deep stacked autoencoders on multi-core systems using synchronized layer-wise pre-training—0
On Architectures and Training for Raw Waveform Feature Extraction in ASR—0
Foundation Model for Wireless Technology Recognition Using IQ Timeseries—0
GFlowNet Pretraining with Inexpensive Rewards—0
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method—0
Show:102550
← PrevPage 3 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified