SOTAVerified

Unsupervised Pre-training

Pre-training a neural network using unsupervised (self-supervised) auxiliary tasks on unlabeled data.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 226–250 of 265 papers

TitleStatusHype
MML: Maximal Multiverse Learning for Robust Fine-Tuning of Language ModelsCode0
Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance SegmentationCode0
Accelerating Training of Transformer-Based Language Models with Progressive Layer DroppingCode0
ZS-VCOS: Zero-Shot Outperforms Supervised Video Camouflaged Object Segmentation with Zero-Shot MethodCode0
m2caiSeg: Semantic Segmentation of Laparoscopic Images using Convolutional Neural NetworksCode0
COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasetsCode0
An Analysis of Unsupervised Pre-training in Light of Recent AdvancesCode0
RMDL: Random Multimodel Deep Learning for ClassificationCode0
Unsupervised Pre-Training of Image Features on Non-Curated DataCode0
Learning Deep Representations Using Convolutional Auto-encoders with Symmetric Skip ConnectionsCode0
LATTE: Label-efficient Incident Phenotyping from Longitudinal Electronic Health RecordsCode0
Knowledge Matters: Importance of Prior Information for OptimizationCode0
Improving Relation Extraction by Pre-trained Language RepresentationsCode0
Tuning Multilingual Transformers for Language-Specific Named Entity RecognitionCode0
Self-Supervised Modality-Agnostic Pre-Training of Swin TransformersCode0
Self-Supervised Pre-Training Boosts Semantic Scene Segmentation on LiDAR DataCode0
Tuning Multilingual Transformers for Named Entity Recognition on Slavic LanguagesCode0
How much do LLMs learn from negative examples?Code0
Self-training and Pre-training are Complementary for Speech RecognitionCode0
How far can we go without convolution: Improving fully-connected networksCode0
Greedy-layer Pruning: Speeding up Transformer Models for Natural Language ProcessingCode0
Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent AgentsCode0
From Recognition to Prediction: Leveraging Sequence Reasoning for Action AnticipationCode0
CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion RecognitionCode0
GiBERT: Enhancing BERT with Linguistic Information using a Lightweight Gated Injection MethodCode0
Show:102550
← PrevPage 10 of 11Next →
All datasetsMeaslesUCI measles

Benchmark Results

#ModelMetricClaimedVerifiedStatus
115RDLsAccuracy (%)95—Unverified
29RDLsAccuracy (%)94—Unverified
33 RMDLAccuracy (%)93—Unverified
4CNNAccuracy (%)73—Unverified
5RMDLAccuracy (%)0.1—Unverified
#ModelMetricClaimedVerifiedStatus
1RMDL (30 RDLs)Sensitivity (VEB)90.69—Unverified
2Sensitivity89.1—Unverified
3RMDL 3 RDLsSensitivity0.87—Unverified