SOTAVerified

Representation Learning

Representation Learning is a process in machine learning where algorithms extract meaningful patterns from raw data to create representations that are easier to understand and process. These representations can be designed for interpretability, reveal hidden features, or be used for transfer learning. They are valuable across many fundamental machine learning tasks like image classification and retrieval.

Deep neural networks can be considered representation learning models that typically encode information which is projected into a different subspace. These representations are then usually passed on to a linear classifier to, for instance, train a classifier.

Representation learning can be divided into:

  • Supervised representation learning: learning representations on task A using annotated data and used to solve task B
  • Unsupervised representation learning: learning representations on a task in an unsupervised way (label-free data). These are then used to address downstream tasks and reducing the need for annotated data when learning news tasks. Powerful models like GPT and BERT leverage unsupervised representation learning to tackle language tasks.

More recently, self-supervised learning (SSL) is one of the main drivers behind unsupervised representation learning in fields like computer vision and NLP.

Here are some additional readings to go deeper on the task:

( Image credit: Visualizing and Understanding Convolutional Networks )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 5051–5100 of 10580 papers

TitleStatusHype
Learning multi-scale functional representations of proteins from single-cell microscopy data—0
Can representation learning for multimodal image registration be improved by supervision of intermediate layers?—0
Integrating Dependency Tree Into Self-attention for Sentence Representation—0
Direct Coloring for Self-Supervised Enhanced Feature Decoupling—0
Depth Selection for Deep ReLU Nets in Feature Extraction and Generalization—0
Directed Graph Embeddings in Pseudo-Riemannian Manifolds—0
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation—0
A Constituent-Centric Neural Architecture for Reading Comprehension—0
Keep your distance: learning dispersed embeddings on S_m—0
Keep Your Friends Close & Enemies Farther: Debiasing Contrastive Learning with Spatial Priors in 3D Radiology Images—0
Integrating Biological and Machine Intelligence: Attention Mechanisms in Brain-Computer Interfaces—0
KERMIT: Generative Insertion-Based Modeling for Sequences—0
On Mitigating the Utility-Loss in Differentially Private Learning: A new Perspective by a Geometrically Inspired Kernel Approach—0
Depth induces scale-averaging in overparameterized linear Bayesian neural networks—0
Kernel Stochastic Configuration Networks for Nonlinear Regression—0
Kernel Transform Learning—0
KeyGen2Vec: Learning Document Embedding via Multi-label Keyword Generation in Question-Answering—0
Keyphrase Extraction with Dynamic Graph Convolutional Networks and Diversified Inference—0
Learning Multi-Modal Class-Specific Tokens for Weakly Supervised Dense Object Localization—0
KeyRe-ID: Keypoint-Guided Person Re-Identification using Part-Aware Representation in Videos—0
Learning Multi-view Molecular Representations with Structured and Unstructured Knowledge—0
Learning Neural Ranking Models Online from Implicit User Feedback—0
Learning Nuclei Representations with Masked Image Modelling—0
Semi-supervised Visual Feature Integration for Pre-trained Language Models—0
A Novel Generative Model with Causality Constraint for Mitigating Biases in Recommender Systems—0
K-Link: Knowledge-Link Graph from LLMs for Enhanced Representation Learning in Multivariate Time-Series Data—0
DiRW: Path-Aware Digraph Learning for Heterophily—0
XAI Beyond Classification: Interpretable Neural Clustering—0
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition—0
kNN-Embed: Locally Smoothed Embedding Mixtures For Multi-interest Candidate Retrieval—0
Instruction-based Hypergraph Pretraining—0
Fine-grained Early Frequency Attention for Deep Speaker Representation Learning—0
CAPS: A Practical Partition Index for Filtered Similarity Search—0
Knowledge-aware contrastive heterogeneous molecular graph learning—0
Knowledge-aware Contrastive Molecular Graph Learning—0
Knowledge-Aware Deep Dual Networks for Text-Based Mortality Prediction—0
DePRL: Achieving Linear Convergence Speedup in Personalized Decentralized Learning with Shared Representations—0
InstantEmbedding: Efficient Local Node Representations—0
DEPHN: Different Expression Parallel Heterogeneous Network using virtual gradient optimization for Multi-task Learning—0
Learning Meta Word Embeddings by Unsupervised Weighted Concatenation of Source Embeddings—0
Knowledgebra: An Algebraic Learning Framework for Knowledge Graph—0
DisCoRL: Continual Reinforcement Learning via Policy Distillation—0
Knowledge Distillation Under Ideal Joint Classifier Assumption—0
Learning Monolingual Compositional Representations via Bilingual Supervision—0
Enhancing Word-Level Semantic Representation via Dependency Structure for Expressive Text-to-Speech Synthesis—0
Bridging Large Language Models and Graph Structure Learning Models for Robust Representation Learning—0
Knowledge-Embedded Representation Learning for Fine-Grained Image Recognition—0
Capturing Fine-grained Semantics in Contrastive Graph Representation Learning—0
Instance-Conditioned GAN Data Augmentation for Representation Learning—0
Instance-Aware Representation Learning and Association for Online Multi-Person Tracking—0
Show:102550
← PrevPage 102 of 212Next →
All datasetsSciDocsAnimals-10CIFAR10Circle DataSports10

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SciNCLAvg.81.8—Unverified
2SPECTERAvg.80—Unverified
3CiteomaticAvg.76—Unverified
4Sci-DeCLUTRAvg.66.6—Unverified
5SciBERTAvg.59.6—Unverified
6BioBERTAvg.58.8—Unverified
7CiteBERTAvg.58.8—Unverified
#ModelMetricClaimedVerifiedStatus
1top_model_weights_with_3d_21:1 Accuracy0.75—Unverified
#ModelMetricClaimedVerifiedStatus
1Resnet 18Accuracy (%)97.05—Unverified
#ModelMetricClaimedVerifiedStatus
1Morphological NetworkAccuracy97.3—Unverified
#ModelMetricClaimedVerifiedStatus
1Max Margin ContrastiveSilhouette Score0.56—Unverified