SOTAVerified

Representation Learning

Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.

Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.

Representation learning can be divided into:

  • Supervised representation learning: learning representations on task A using annotated data and used to solve task B
  • Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.

More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.

Here are some additional readings to go deeper on the task:

( Image credit: Visualizing and Understanding Convolutional Networks )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 4901–4950 of 10580 papers

TitleStatusHype
Counterfactual Representation Learning with Balancing Weights—0
General-purpose audio representation learning for real-world sound scenes—0
AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection—0
A vector quantized masked autoencoder for audiovisual speech emotion recognition—0
Generalizing to Unseen Domains: A Survey on Domain Generalization—0
Generalizing Supervised Contrastive learning: A Projection Perspective—0
Generalizing Reinforcement Learning to Unseen Actions—0
Generalizing Multi-Step Inverse Models for Representation Learning to Finite-Memory POMDPs—0
Costs and Benefits of Fair Regression—0
Generalized User Representations for Transfer Learning—0
Out-of-Distribution Representation Learning for Time Series Classification—0
Cost-effective Variational Active Entity Resolution—0
Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments—0
Generalized Laplacian Positional Encoding for Graph Representation Learning—0
Generalized Information Bottleneck for Gaussian Variables—0
COSINE: Compressive Network Embedding on Large-scale Information Networks—0
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring—0
A Vector Model for Type-Theoretical Semantics—0
A Dataset for Learning Graph Representations to Predict Customer Returns in Fashion Retail—0
Generalized Category Discovery with Clustering Assignment Consistency—0
CorrSigNet: Learning CORRelated Prostate Cancer SIGnatures from Radiology and Pathology Images for Improved Computer Aided Diagnosis—0
Generalized and Transferable Patient Language Representation for Phenotyping with Limited Data—0
CorrMAE: Pre-training Correspondence Transformers with Masked Autoencoder—0
A Variance Reduction Method for Neural-based Divergence Estimation—0
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior—0
Auxiliary task discovery through generate-and-test—0
Generalization Bounds and Representation Learning for Estimation of Potential Outcomes and Causal Effects—0
Generalization bounds and algorithms for estimating conditional average treatment effect of dosage—0
Generalization bound for estimating causal effects from observational network data—0
Correlation based Multi-phasal models for improved imagined speech EEG recognition—0
Generalization Analysis for Deep Contrastive Representation Learning—0
Generalization Analysis for Contrastive Representation Learning under Non-IID Settings—0
Generalization Analysis for Contrastive Representation Learning—0
Generalizable Zero-Shot Speaker Adaptive Speech Synthesis with Disentangled Representations—0
Auxiliary Reward Generation with Transition Distance Representation Learning—0
A Modular Theory of Feature Learning—0
Generalizable task representation learning from human demonstration videos: a geometric approach—0
Correlated Attention in Transformers for Multivariate Time Series—0
Generalizable Representation Learning for Mixture Domain Face Anti-Spoofing—0
Generalizable Low-Resource Activity Recognition with Diverse and Discriminative Representation Learning—0
Generalizable Information Theoretic Causal Representation—0
Co-Representation Learning For Classification and Novel Class Detection via Deep Networks—0
Auto-weighted low-rank representation for clustering—0
A Model of Two Tales: Dual Transfer Learning Framework for Improved Long-tail Item Recommendation—0
General Item Representation Learning for Cold-start Content Recommendations—0
Core-Periphery Principle Guided State Space Model for Functional Connectome Classification—0
CoReFace: Sample-Guided Contrastive Regularization for Deep Face Recognition—0
Gene-Level Representation Learning via Interventional Style Transfer in Optical Pooled Screening—0
GenEFT: Understanding Statics and Dynamics of Model Generalization via Effective Theory—0
Gene finding revisited: improved robustness through structured decoding from learned embeddings—0
Show:102550
← PrevPage 99 of 212Next →
All datasetsSciDocsAnimals-10CIFAR10Circle DataSports10

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SciNCLAvg.81.8—Unverified
2SPECTERAvg.80—Unverified
3CiteomaticAvg.76—Unverified
4Sci-DeCLUTRAvg.66.6—Unverified
5SciBERTAvg.59.6—Unverified
6BioBERTAvg.58.8—Unverified
7CiteBERTAvg.58.8—Unverified
#ModelMetricClaimedVerifiedStatus
1top_model_weights_with_3d_21:1 Accuracy0.75—Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet 18Accuracy (%)97.05—Unverified
#ModelMetricClaimedVerifiedStatus
1Morphological NetworkAccuracy97.3—Unverified
#ModelMetricClaimedVerifiedStatus
1Max Margin ContrastiveSilhouette Score0.56—Unverified