SOTAVerified

Representation Learning

Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.

Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.

Representation learning can be divided into:

  • Supervised representation learning: learning representations on task A using annotated data and used to solve task B
  • Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.

More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.

Here are some additional readings to go deeper on the task:

( Image credit: Visualizing and Understanding Convolutional Networks )

Papers

Showing 29513000 of 10580 papers

TitleStatusHype
Controllable Chest X-Ray Report Generation from Longitudinal Representations0
Semantic-aware Temporal Channel-wise Attention for Cardiac Function Assessment0
Transcending the Attention Paradigm: Representation Learning from Geospatial Social Media DataCode0
PointGAT: A quantum chemical property prediction model integrating graph attention and 3D geometry0
VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial IntelligenceCode1
Enhancing Representations through Heterogeneous Self-Supervised Learning0
Breaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection0
Task Aware Modulation using Representation Learning: An Approach for Few Shot Learning in Environmental Systems0
T-Rep: Representation Learning for Time Series using Time-EmbeddingsCode1
URLOST: Unsupervised Representation Learning without Stationarity or Topology0
Identifying Representations for Intervention Extrapolation0
Improving Reinforcement Learning Efficiency with Auxiliary Tasks in Non-Visual Environments: A Comparison0
HuBERTopic: Enhancing Semantic Representation of HuBERT through Self-supervision Utilizing Topic Model0
Certifiably Robust Graph Contrastive LearningCode1
Audio Event-Relational Graph Representation Learning for Acoustic Scene ClassificationCode1
Evaluating Self-Supervised Speech Representations for Indigenous American Languages0
Know2BIO: A Comprehensive Dual-View Benchmark for Evolving Biomedical Knowledge GraphsCode1
Ablation Study to Clarify the Mechanism of Object Segmentation in Multi-Object Representation Learning0
Expedited Training of Visual Conditioned Language Generation via Redundancy ReductionCode0
Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses0
Enhancing Robust Representation in Adversarial Training: Alignment and Exclusion CriteriaCode0
OMG-ATTACK: Self-Supervised On-Manifold Generation of Transferable Evasion Attacks0
COOLer: Class-Incremental Learning for Appearance-Based Multiple Object TrackingCode0
Multi-Domain Causal Representation Learning via Weak Distributional Invariances0
Co-modeling the Sequential and Graphical Routes for Peptide Representation LearningCode0
Human-oriented Representation Learning for Robotic Manipulation0
FroSSL: Frobenius Norm Minimization for Efficient Multiview Self-Supervised LearningCode0
ScaleNet: An Unsupervised Representation Learning Method for Limited Information0
AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context RetrievalCode0
MUSCLE: Multi-task Self-supervised Continual Learning to Pre-train Deep Models for X-ray Images of Multiple Body Parts0
Conditional Instrumental Variable Regression with Representation Learning for Causal Inference0
OOD Aware Supervised Contrastive Learning0
Transformers are efficient hierarchical chemical graph learnersCode0
Algebras of actions in an agent's representations of the world0
Segmenting the motion components of a video: A long-term unsupervised model0
Strength in Diversity: Multi-Branch Representation Learning for Vehicle Re-IdentificationCode1
Segment Any Building0
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP0
A Unified View on Neural Message Passing with Opinion Dynamics for Social Networks0
DINE: Dimensional Interpretability of Node EmbeddingsCode0
Localized and Balanced Efficient Incomplete Multi-view Clustering0
Learning node representation via Motif CoarseningCode0
Siamese Representation Learning for Unsupervised Relation ExtractionCode0
LSOR: Longitudinally-Consistent Self-Organized Representation LearningCode0
MVC: A Multi-Task Vision Transformer Network for COVID-19 Diagnosis from Chest X-ray Images0
Structural Adversarial Objectives for Self-Supervised Representation LearningCode0
Efficient Planning with Latent Diffusion0
MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph DataCode1
SCoRe: Submodular Combinatorial Representation Learning0
Learning Over Molecular Conformer Ensembles: Datasets and BenchmarksCode1
Show:102550
← PrevPage 60 of 212Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SciNCLAvg.81.8Unverified
2SPECTERAvg.80Unverified
3CiteomaticAvg.76Unverified
4Sci-DeCLUTRAvg.66.6Unverified
5SciBERTAvg.59.6Unverified
6BioBERTAvg.58.8Unverified
7CiteBERTAvg.58.8Unverified
#ModelMetricClaimedVerifiedStatus
1top_model_weights_with_3d_21:1 Accuracy0.75Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet 18Accuracy (%)97.05Unverified
#ModelMetricClaimedVerifiedStatus
1Morphological NetworkAccuracy97.3Unverified
#ModelMetricClaimedVerifiedStatus
1Max Margin ContrastiveSilhouette Score0.56Unverified