SOTAVerified

Representation Learning

Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.

Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.

Representation learning can be divided into:

  • Supervised representation learning: learning representations on task A using annotated data and used to solve task B
  • Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.

More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.

Here are some additional readings to go deeper on the task:

( Image credit: Visualizing and Understanding Convolutional Networks )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2651–2700 of 10580 papers

TitleStatusHype
A Multimodal Translation-Based Approach for Knowledge Graph Representation Learning—0
Balancing Continual Learning and Fine-tuning for Human Activity Recognition—0
Exploiting Group-level Behavior Pattern forSession-based Recommendation—0
Exploiting segmentation labels and representation learning to forecast therapy response of PDAC patients—0
Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptation—0
Balance Regularized Neural Network Models for Causal Effect Estimation—0
Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learning—0
A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification—0
Graph Inference Representation: Learning Graph Positional Embeddings with Anchor Path Encoding—0
Exploiting Sentence and Context Representations in Deep Neural Models for Spoken Language Understanding—0
Cross-Dimensional Medical Self-Supervised Representation Learning Based on a Pseudo-3D Transformation—0
A Clinical-oriented Multi-level Contrastive Learning Method for Disease Diagnosis in Low-quality Medical Images—0
Cross-attention-based saliency inference for predicting cancer metastasis on whole slide images—0
Multimodal Audio-Visual Information Fusion using Canonical-Correlated Graph Neural Network for Energy-Efficient Speech Enhancement—0
Exploiting Invertible Decoders for Unsupervised Sentence Representation Learning—0
Self-Supervised Tracking via Target-Aware Data Synthesis—0
Additional Positive Enables Better Representation Learning for Medical Images—0
A Multi-Metric Latent Factor Model for Analyzing High-Dimensional and Sparse data—0
Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations: a COVID-19 case-study—0
Exploiting MMD and Sinkhorn Divergences for Fair and Transferable Representation Learning—0
CRL+: A Novel Semi-Supervised Deep Active Contrastive Representation Learning-Based Text Classification Model for Insurance Data—0
A Multi-Granularity Matching Attention Network for Query Intent Classification in E-commerce Retrieval—0
Critical Learning Periods in Deep Networks—0
Back to the Drawing Board for Fair Representation Learning—0
FIMP: Foundation Model-Informed Message Passing for Graph Neural Networks—0
Creating Your Editable 3D Photorealistic Avatar with Tetrahedron-constrained Gaussian Splatting—0
Creating small but meaningful representations of digital pathology images—0
AdaVid: Adaptive Video-Language Pretraining—0
Creating generalizable downstream graph models with random projections—0
A Zero-shot Learning Method Based on Large Language Models for Multi-modal Knowledge Graph Embedding—0
Amortized Variational Inference: A Systematic Review—0
CRCL: Causal Representation Consistency Learning for Anomaly Detection in Surveillance Videos—0
AXM-Net: Implicit Cross-Modal Feature Alignment for Person Re-identification—0
Amortized Inference Regularization—0
COVID-19 Detection Based on Self-Supervised Transfer Learning Using Chest X-Ray Images—0
A Visual Analytics Framework for Contrastive Network Analysis—0
CATD: Unified Representation Learning for EEG-to-fMRI Cross-Modal Generation—0
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning—0
Expressiveness in Deep Reinforcement Learning—0
Covariate-informed Representation Learning to Prevent Posterior Collapse of iVAE—0
Coupling Visual Semantics of Artificial Neural Networks and Human Brain Function via Synchronized Activations—0
A Vision Check-up for Language Models—0
Coupling-based Invertible Neural Networks Are Universal Diffeomorphism Approximators—0
Coupled Representation Learning for Domains, Intents and Slots in Spoken Language Understanding—0
A Vision Centric Remote Sensing Benchmark—0
Counterfactual Representation Learning with Balancing Weights—0
AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection—0
A vector quantized masked autoencoder for audiovisual speech emotion recognition—0
Costs and Benefits of Fair Regression—0
A Vector Model for Type-Theoretical Semantics—0
Show:102550
← PrevPage 54 of 212Next →
All datasetsSciDocsAnimals-10CIFAR10Circle DataSports10

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SciNCLAvg.81.8—Unverified
2SPECTERAvg.80—Unverified
3CiteomaticAvg.76—Unverified
4Sci-DeCLUTRAvg.66.6—Unverified
5SciBERTAvg.59.6—Unverified
6BioBERTAvg.58.8—Unverified
7CiteBERTAvg.58.8—Unverified
#ModelMetricClaimedVerifiedStatus
1top_model_weights_with_3d_21:1 Accuracy0.75—Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet 18Accuracy (%)97.05—Unverified
#ModelMetricClaimedVerifiedStatus
1Morphological NetworkAccuracy97.3—Unverified
#ModelMetricClaimedVerifiedStatus
1Max Margin ContrastiveSilhouette Score0.56—Unverified