SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 265 papers

TitleStatusHype
Behavior From the Void: Unsupervised Active Pre-TrainingCode1
ES-Net: An Efficient Stereo Matching NetworkCode1
DOBF: A Deobfuscation Pre-Training Objective for Programming LanguagesCode1
CATE: Computation-aware Neural Architecture Encoding with TransformersCode1
Unsupervised Semantic Segmentation by Contrasting Object Mask ProposalsCode1
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated LearningCode1
SEED: Self-supervised Distillation For Visual RepresentationCode1
End-to-End Training of Neural Retrievers for Open-Domain Question AnsweringCode1
OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised LearningCode1
TabTransformer: Tabular Data Modeling Using Contextual EmbeddingsCode1
Unsupervised Pre-training for Person Re-identificationCode1
UP-DETR: Unsupervised Pre-training for Object Detection with TransformersCode1
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization ProblemCode1
Image Representations Learned With Unsupervised Pre-Training Contain Human-like BiasesCode1
Unsupervised Vision-and-Language Pre-training Without Parallel Images and CaptionsCode1
A Transformer-based Framework for Multivariate Time Series Representation LearningCode1
Self-training Improves Pre-training for Natural Language UnderstandingCode1
Spatiotemporal Contrastive Video Representation LearningCode1
SeCo: Exploring Sequence Supervision for Unsupervised Representation LearningCode1
PointContrast: Unsupervised Pre-training for 3D Point Cloud UnderstandingCode1
A Further Study of Unsupervised Pre-training for Transformer Based Speech RecognitionCode1
Rolling-Unrolling LSTMs for Action Anticipation from First-Person VideoCode1
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction TaskCode1
Improving Transformer-based Speech Recognition Using Unsupervised Pre-trainingCode1
Leveraging Pre-trained Checkpoints for Sequence Generation TasksCode1
wav2vec: Unsupervised Pre-training for Speech RecognitionCode1
Multilingual Constituency Parsing with Self-Attention and Pre-TrainingCode1
Exact solutions to the nonlinear dynamics of learning in deep linear neural networksCode1
Foundation Model for Wireless Technology Recognition Using IQ Timeseries—0
Is MixIT Really Unsuitable for Correlated Sources? Exploring MixIT for Unsupervised Pre-training in Music Source Separation—0
The Efficiency of Pre-training with Objective Masking in Pseudo Labeling for Semi-Supervised Text Classification—0
Latte: Transfering LLMs` Latent-level Knowledge for Few-shot Tabular Learning—0
Risk Assessment Framework for Code LLMs via Leveraging Internal States—0
ZS-VCOS: Zero-Shot Outperforms Supervised Video Camouflaged Object SegmentationCode0
ZS-VCOS: Zero-Shot Outperforms Supervised Video Camouflaged Object Segmentation with Zero-Shot MethodCode0
How much do LLMs learn from negative examples?Code0
Pretraining Generative Flow Networks with Inexpensive Rewards for Molecular Graph Generation—0
Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models—0
Incomplete Multi-View Multi-label Learning via Disentangled Representation and Label Semantic Embedding—0
Targeted Forgetting of Image Subgroups in CLIP Models—0
HindiLLM: Large Language Model for Hindi—0
Transferring self-supervised pre-trained models for SHM data anomaly detection with scarce labeled data—0
CLAP: Unsupervised 3D Representation Learning for Fusion 3D Perception via Curvature Sampling and Prototype Learning—0
Point Cloud Unsupervised Pre-training via 3D Gaussian Splatting—0
Take Package as Language: Anomaly Detection Using TransformerCode0
SynCo: Synthetic Hard Negatives in Contrastive Learning for Better Unsupervised Visual RepresentationsCode0
Calibrating Language Models with Adaptive Temperature ScalingCode0
Range-aware Positional Encoding via High-order Pretraining: Theory and Practice—0
GFlowNet Pretraining with Inexpensive Rewards—0
TraIL-Det: Transformation-Invariant Local Feature Networks for 3D LiDAR Object Detection with Unsupervised Pre-Training—0
Show:102550
← PrevPage 2 of 6Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified