SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 265 papers

TitleStatusHype
CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion RecognitionCode0
MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning—0
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage RetrievalCode1
Unsupervised Pre-Training for 3D Leaf Instance Segmentation—0
FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs—0
Unified Multi-modal Unsupervised Representation Learning for Skeleton-based Action UnderstandingCode1
Unsupervised Pre-Training Using Masked Autoencoders for ECG Analysis—0
Semi-Supervised End-To-End Contrastive Learning For Time Series Classification—0
METRA: Scalable Unsupervised RL with Metric-Aware AbstractionCode1
Automated clinical coding using off-the-shelf large language models—0
CUPre: Cross-domain Unsupervised Pre-training for Few-Shot Cell Segmentation—0
Classifying Whole Slide Images: What Matters?—0
Pre-Training and Fine-Tuning Generative Flow Networks—0
Differentially Private Optimization for Non-Decomposable Objective Functions—0
A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting)—0
Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project—0
Examining the Effect of Pre-training on Time Series Classification—0
Self-Supervised Pre-Training Boosts Semantic Scene Segmentation on LiDAR DataCode0
Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training—0
Masked Feature Modelling: Feature Masking for the Unsupervised Pre-training of a Graph Attention Network Block for Bottom-up Video Event Recognition—0
Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning—0
Towards General Text Embeddings with Multi-stage Contrastive Learning—0
HIQL: Offline Goal-Conditioned RL with Latent States as ActionsCode1
Disentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction—0
ECGBERT: Understanding Hidden Language of ECGs with Self-Supervised Representation Learning—0
Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement LearningCode1
Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human FeedbackCode0
Rethinking Semi-supervised Learning with Language ModelsCode1
PTGB: Pre-Train Graph Neural Networks for Brain Network AnalysisCode1
LATTE: Label-efficient Incident Phenotyping from Longitudinal Electronic Health RecordsCode0
FreePoint: Unsupervised Point Cloud Instance SegmentationCode1
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful LearnerCode1
PUNR: Pre-training with User Behavior Modeling for News RecommendationCode0
Incorporating Unlabelled Data into Bayesian Neural Networks—0
Unsupervised Pre-Training For Data-Efficient Text-to-Speech On Low Resource LanguagesCode1
MultiTalent: A Multi-Dataset Approach to Medical Image SegmentationCode1
Generalized 3D Self-supervised Learning Framework via Prompted Foreground-Aware Feature ContrastCode0
Research on CPI Prediction Based on Natural Language Processing—0
Device Tuning for Multi-Task Large Model—0
A Benchmark of Nested Named Entity Recognition Approaches in Historical Structured Documents—0
DocILE Benchmark for Document Information Localization and ExtractionCode1
Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Prompt—0
Self-FuseNet: Data Free Unsupervised Remote Sensing Image Super-Resolution—0
Unsupervised Pre-Training for Vietnamese Automatic Speech Recognition in the HYKIST Project—0
Wukong-Reader: Multi-modal Pre-training for Fine-grained Visual Document UnderstandingCode0
ACROBAT -- a multi-stain breast cancer histological whole-slide-image data set from routine diagnostics for computational pathology—0
EUCLID: Towards Efficient Unsupervised Reinforcement Learning with Multi-choice Dynamics Model—0
Spiral Contrastive Learning: An Efficient 3D Representation Learning Method for Unannotated CT Lesions—0
Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning—0
ProposalContrast: Unsupervised Pre-training for LiDAR-based 3D Object DetectionCode1
Show:102550
← PrevPage 2 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified