SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 265 papers

TitleStatusHype
Unsupervised pre-training of graph transformers on patient population graphsCode1
SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite ImageryCode2
Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis—0
Unsupervised Instance Discriminative Learning for Depression Detection from Speech Signals—0
Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question AnsweringCode0
CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World DomainsCode1
Curriculum-Based Self-Training Makes Better Few-Shot Learners for Data-to-Text GenerationCode0
Self-Supervised Visual Representation Learning with Semantic GroupingCode1
Deep Features for CBIR with Scarce Data using Hebbian Learning—0
Semi-supervised 3D shape segmentation with multilevel consistency and part substitutionCode1
ELECTRIcity: An Efficient Transformer for Non-Intrusive Load MonitoringCode1
Large-Scale Pre-training for Person Re-identification with Noisy LabelsCode2
Unsupervised Pre-training for Temporal Action Localization TasksCode1
Reinforcement Learning with Action-Free Pre-Training from VideosCode1
Unsupervised Pre-Training on Patient Population Graphs for Patient-Level PredictionsCode1
COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasetsCode0
Boundary-aware Information Maximization for Self-supervised Medical Image Segmentation—0
Korean-Specific Dataset for Table Question AnsweringCode1
The CLEAR Benchmark: Continual LEArning on Real-World ImageryCode1
3D Intracranial Aneurysm Classification and Segmentation via Unsupervised Dual-branch Learning—0
Unleashing Potential of Unsupervised Pre-Training With Intra-Identity Regularization for Person Re-Identification—0
AI-Bind: Improving Binding Predictions for Novel Protein Targets and LigandsCode1
SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual RepresentationsCode1
4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding—0
Unleashing the Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-IdentificationCode0
Bag of Tricks and A Strong baseline for Image Copy DetectionCode1
D^2LV: A Data-Driven and Local-Verification Approach for Image Copy DetectionCode1
GiBERT: Enhancing BERT with Linguistic Information using a Lightweight Gated Injection MethodCode0
Improving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment—0
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training—0
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech RecognitionCode1
Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference—0
RandomRooms: Unsupervised Pre-training from Synthetic Shapes and Randomized Layouts for 3D Object DetectionCode1
Triplet Contrastive Learning for Brain Tumor Classification—0
Residual Contrastive Learning for Image Reconstruction: Learning Transferable Representations from Noisy Images—0
Improving On-Screen Sound Separation for Open-Domain Videos with Audio-Visual Self-Attention—0
Learning of feature points without additional supervision improves reinforcement learning from imagesCode0
Automatic Sexism Detection with Multilingual Transformer Models—0
PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-trainingCode1
Exploring the Limits of Out-of-Distribution DetectionCode1
Greedy-layer Pruning: Speeding up Transformer Models for Natural Language ProcessingCode0
Initialization and Regularization of Factorized Neural LayersCode1
Audio Transformers—0
SYNFIX: Automatically Fixing Syntax Errors using Compiler Diagnostics—0
A Large-Scale Study on Unsupervised Spatiotemporal Representation LearningCode0
Representation Learning for Weakly Supervised Relation Extraction—0
Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG ModelingCode1
On Architectures and Training for Raw Waveform Feature Extraction in ASR—0
Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models—0
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing DataCode1
Show:102550
← PrevPage 3 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified