SOTAVerified

Representation Learning

Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.

Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.

Representation learning can be divided into:

  • Supervised representation learning: learning representations on task A using annotated data and used to solve task B
  • Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.

More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.

Here are some additional readings to go deeper on the task:

( Image credit: Visualizing and Understanding Convolutional Networks )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 7351–7400 of 10580 papers

TitleStatusHype
Predictive Learning: Using Future Representation Learning Variantial Autoencoder for Human Action Prediction—0
Predictive Modeling of Homeless Service Assignment: A Representation Learning Approach—0
Predictive Representation Learning for Language Modeling—0
Preference or Intent? Double Disentangled Collaborative Filtering—0
Highly-Economized Multi-View Binary Compression for Scalable Image Clustering—0
Prerequisite Relation Learning for Concepts in MOOCs—0
Deep Discrete Encoders: Identifiable Deep Generative Models for Rich Data with Discrete Latent Layers—0
High-Frequency-aware Hierarchical Contrastive Selective Coding for Representation Learning on Text-attributed Graphs—0
An Empirical Study of Representation, Training and Decoding for Span-based Named Entity Recognition—0
High-Fidelity Audio Generation and Representation Learning with Guided Adversarial Autoencoder—0
Higher-order mutual information reveals synergistic sub-networks for multi-neuron importance—0
Deep Dictionary Learning with An Intra-class Constraint—0
Deep Determinantal Point Process for Large-Scale Multi-Label Classification—0
An Empirical Study of Self-supervised Learning with Wasserstein Distance—0
Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques—0
Pushing the Limits of 3D Shape Generation at Scale—0
High-dimensional multimodal uncertainty estimation by manifold alignment:Application to 3D right ventricular strain computations—0
Deep Descriptive Clustering—0
Bilingual Word Representations with Monolingual Quality in Mind—0
High-Dimensional Bayesian Optimization with Constraints: Application to Powder Weighing—0
Deep denoising autoencoder-based non-invasive blood flow detection for arteriovenous fistula—0
Billion-Scale Pretraining with Vision Transformers for Multi-Task Visual Representations—0
A Comparison of Representation Learning Methods for Dimensionality Reduction of fMRI Scans for Classification of ADHD—0
Hi-Gen: Generative Retrieval For Large-Scale Personalized E-commerce Search—0
HierPromptLM: A Pure PLM-based Framework for Representation Learning on Heterogeneous Text-rich Networks—0
Deep Coupled-Representation Learning for Sparse Linear Inverse Problems with Side Information—0
Pre-Training Transformers as Energy-Based Cloze Models—0
Pre-training Transformers for Molecular Property Prediction Using Reaction Prediction—0
Hierarchical Visual Categories Modeling: A Joint Representation Learning and Density Estimation Framework for Out-of-Distribution Detection—0
Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models—0
Deep Convolutional Transform Learning -- Extended version—0
Pushing Auto-regressive Models for 3D Shape Generation at Capacity and Scalability—0
PVLR: Prompt-driven Visual-Linguistic Representation Learning for Multi-Label Image Recognition—0
Quality Estimation Using Round-trip Translation with Sentence Embeddings—0
Rapid detection of rare events from in situ X-ray diffraction data using machine learning—0
From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modeling—0
Regeneration Learning: A Learning Paradigm for Data Generation—0
Hierarchical Uncertainty-Aware Graph Neural Network—0
RLHF from Heterogeneous Feedback via Personalization and Preference Aggregation—0
From Local Binary Patterns to Pixel Difference Networks for Efficient Visual Representation Learning—0
Pseudo-Representation Labeling Semi-Supervised Learning—0
Hierarchical Transformer for Scalable Graph Learning—0
Understanding Deep Contrastive Learning via Coordinate-wise Optimization—0
Prior Learning in Introspective VAEs—0
Bilingual Lexicon Induction by Learning to Combine Word-Level and Character-Level Representations—0
From Pixels to Gigapixels: Bridging Local Inductive Bias and Long-Range Dependencies with Pixel-Mamba—0
Privacy Adversarial Network: Representation Learning for Mobile Data Privacy—0
Privacy-Aware Adversarial Network in Human Mobility Prediction—0
Privacy-Aware Human Mobility Prediction via Adversarial Networks—0
PSHop: A Lightweight Feed-Forward Method for 3D Prostate Gland Segmentation—0
Show:102550
← PrevPage 148 of 212Next →
All datasetsSciDocsAnimals-10CIFAR10Circle DataSports10

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SciNCLAvg.81.8—Unverified
2SPECTERAvg.80—Unverified
3CiteomaticAvg.76—Unverified
4Sci-DeCLUTRAvg.66.6—Unverified
5SciBERTAvg.59.6—Unverified
6BioBERTAvg.58.8—Unverified
7CiteBERTAvg.58.8—Unverified
#ModelMetricClaimedVerifiedStatus
1top_model_weights_with_3d_21:1 Accuracy0.75—Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet 18Accuracy (%)97.05—Unverified
#ModelMetricClaimedVerifiedStatus
1Morphological NetworkAccuracy97.3—Unverified
#ModelMetricClaimedVerifiedStatus
1Max Margin ContrastiveSilhouette Score0.56—Unverified