| Dynamic data sampler for cross-language transfer learning in large language models | May 17, 2024 | Language ModelingLanguage Modelling | CodeCode Available | 7 | 5 |
| Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models | Jun 5, 2025 | RerankingRetrieval | CodeCode Available | 5 | 5 |
| DepthSplat: Connecting Gaussian Splatting and Depth | Oct 17, 2024 | Depth EstimationNovel View Synthesis | CodeCode Available | 5 | 5 |
| Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI | May 29, 2024 | EEGElectroencephalogram (EEG) | CodeCode Available | 4 | 5 |
| A Survey on Data Selection for Language Models | Feb 26, 2024 | SurveyUnsupervised Pre-training | CodeCode Available | 3 | 5 |
| FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learning | Dec 16, 2024 | DeepFake Detectiondiffusion-generated faces detection | CodeCode Available | 2 | 5 |
| SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery | Jul 17, 2022 | Land Cover ClassificationSemantic Segmentation | CodeCode Available | 2 | 5 |
| Large-Scale Pre-training for Person Re-identification with Noisy Labels | Mar 30, 2022 | Contrastive LearningMulti-Object Tracking | CodeCode Available | 2 | 5 |
| CrystalFormer-RL: Reinforcement Fine-Tuning for Materials Design | Apr 3, 2025 | Band GapDielectric Constant | CodeCode Available | 2 | 5 |
| Foundation Policies with Hilbert Representations | Feb 23, 2024 | Reinforcement Learning (RL)Unsupervised Pre-training | CodeCode Available | 2 | 5 |
| Pre-training strategies and datasets for facial representation learning | Mar 30, 2021 | 3D Face Reconstruction3D Facial Landmark Localization | CodeCode Available | 1 | 5 |
| PEAC: Unsupervised Pre-training for Cross-Embodiment Reinforcement Learning | May 23, 2024 | reinforcement-learningReinforcement Learning | CodeCode Available | 1 | 5 |
| PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-Identification | Aug 10, 2024 | Contrastive LearningPerson Re-Identification | CodeCode Available | 1 | 5 |
| Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning | May 29, 2023 | Autonomous DrivingDecoder | CodeCode Available | 1 | 5 |
| OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning | Dec 21, 2020 | object-detectionObject Detection | CodeCode Available | 1 | 5 |
| PEBBLE: Feedback-Efficient Interactive Reinforcement Learning via Relabeling Experience and Unsupervised Pre-training | Jun 9, 2021 | reinforcement-learningReinforcement Learning (RL) | CodeCode Available | 1 | 5 |
| ProposalContrast: Unsupervised Pre-training for LiDAR-based 3D Object Detection | Jul 26, 2022 | 3D Object Detectionobject-detection | CodeCode Available | 1 | 5 |
| METRA: Scalable Unsupervised RL with Metric-Aware Abstraction | Oct 13, 2023 | Reinforcement Learning (RL)Unsupervised Pre-training | CodeCode Available | 1 | 5 |
| ELECTRIcity: An Efficient Transformer for Non-Intrusive Load Monitoring | Apr 11, 2022 | Non-Intrusive Load MonitoringUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval | Jan 20, 2024 | DecoderPassage Retrieval | CodeCode Available | 1 | 5 |
| MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization Problem | Nov 9, 2020 | Data AugmentationExtractive Tags Summarization | CodeCode Available | 1 | 5 |
| Exact solutions to the nonlinear dynamics of learning in deep linear neural networks | Dec 20, 2013 | Unsupervised Pre-training | CodeCode Available | 1 | 5 |
| ConStyle v2: A Strong Prompter for All-in-One Image Restoration | Jun 26, 2024 | AllGPU | CodeCode Available | 1 | 5 |
| FreePoint: Unsupervised Point Cloud Instance Segmentation | May 11, 2023 | Instance SegmentationSegmentation | CodeCode Available | 1 | 5 |
| Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG Modeling | Apr 9, 2021 | Contrastive LearningElectrocardiography (ECG) | CodeCode Available | 1 | 5 |
| Bag of Tricks and A Strong baseline for Image Copy Detection | Nov 13, 2021 | Copy DetectionUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| Behavior From the Void: Unsupervised Active Pre-Training | Mar 8, 2021 | Atari GamesReinforcement Learning (RL) | CodeCode Available | 1 | 5 |
| Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition | Sep 14, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 | 5 |
| HIQL: Offline Goal-Conditioned RL with Latent States as Actions | Jul 22, 2023 | Reinforcement Learning (RL)Unsupervised Pre-training | CodeCode Available | 1 | 5 |
| PointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding | Jul 21, 2020 | Point Cloud Pre-trainingRepresentation Learning | CodeCode Available | 1 | 5 |
| Leveraging Pre-trained Checkpoints for Sequence Generation Tasks | Jul 29, 2019 | DecoderMachine Translation | CodeCode Available | 1 | 5 |
| Multilingual Constituency Parsing with Self-Attention and Pre-Training | Dec 31, 2018 | Constituency ParsingUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| CARLANE: A Lane Detection Benchmark for Unsupervised Domain Adaptation from Simulation to multiple Real-World Domains | Jun 16, 2022 | 2D Semantic SegmentationAutonomous Driving | CodeCode Available | 1 | 5 |
| Initialization and Regularization of Factorized Neural Layers | May 3, 2021 | Knowledge DistillationModel Compression | CodeCode Available | 1 | 5 |
| Korean-Specific Dataset for Table Question Answering | Jan 17, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 | 5 |
| D^2LV: A Data-Driven and Local-Verification Approach for Image Copy Detection | Nov 13, 2021 | Copy DetectionUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning | Feb 4, 2021 | Federated LearningUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| CATE: Computation-aware Neural Architecture Encoding with Transformers | Feb 14, 2021 | AutoMLNeural Architecture Search | CodeCode Available | 1 | 5 |
| DocILE Benchmark for Document Information Localization and Extraction | Feb 11, 2023 | Key Information ExtractionUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner | May 2, 2023 | SentenceUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| A Transformer-based Framework for Multivariate Time Series Representation Learning | Oct 6, 2020 | Computational EfficiencyGeneral Classification | CodeCode Available | 1 | 5 |
| Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases | Oct 28, 2020 | BIG-bench Machine LearningFace Recognition | CodeCode Available | 1 | 5 |
| A Further Study of Unsupervised Pre-training for Transformer Based Speech Recognition | May 20, 2020 | speech-recognitionSpeech Recognition | CodeCode Available | 1 | 5 |
| Exploring the Limits of Out-of-Distribution Detection | Jun 6, 2021 | Out-of-Distribution DetectionOut of Distribution (OOD) Detection | CodeCode Available | 1 | 5 |
| End-to-End Training of Neural Retrievers for Open-Domain Question Answering | Jan 2, 2021 | Natural QuestionsOpen-Domain Question Answering | CodeCode Available | 1 | 5 |
| ES-Net: An Efficient Stereo Matching Network | Mar 5, 2021 | Autonomous DrivingDepth Estimation | CodeCode Available | 1 | 5 |
| BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers | Apr 29, 2024 | RetrievalUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| AI-Bind: Improving Binding Predictions for Novel Protein Targets and Ligands | Dec 25, 2021 | Drug DiscoveryUnsupervised Pre-training | CodeCode Available | 1 | 5 |
| DOBF: A Deobfuscation Pre-Training Objective for Programming Languages | Feb 15, 2021 | Code SearchCode Translation | CodeCode Available | 1 | 5 |
| Improving Transformer-based Speech Recognition Using Unsupervised Pre-training | Oct 22, 2019 | speech-recognitionSpeech Recognition | CodeCode Available | 1 | 5 |
