| Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation | Nov 1, 2022 | image-classificationImage Classification | —Unverified | 0 | 0 |
| Detecting Bias in Large Language Models: Fine-tuned KcBERT | Mar 16, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| DAWSON: Data Augmentation using Weak Supervision On Natural Language | Nov 16, 2021 | Data AugmentationLanguage Modeling | —Unverified | 0 | 0 |
| Retrieval Augmented Language Model Pre-Training | Jan 1, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Data Augmentation for Biomedical Factoid Question Answering | Jan 16, 2022 | Data AugmentationInformation Retrieval | —Unverified | 0 | 0 |
| Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring | Oct 13, 2020 | AllAutomated Essay Scoring | —Unverified | 0 | 0 |
| Contextual Representation Learning beyond Masked Language Modeling | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training | Oct 11, 2022 | GPUKnowledge Graphs | —Unverified | 0 | 0 |
| XGPT: Cross-modal Generative Pre-Training for Image Captioning | Mar 3, 2020 | Data AugmentationDenoising | —Unverified | 0 | 0 |
| Adversarial Soft Prompt Tuning for Cross-Domain Sentiment Analysis | May 1, 2022 | Domain AdaptationLanguage Modeling | —Unverified | 0 | 0 |
| XHate-999: Analyzing and Detecting Abusive Language Across Domains and Languages | Dec 1, 2020 | Abusive LanguageDisentanglement | —Unverified | 0 | 0 |
| SCRIPT: Self-Critic PreTraining of Transformers | Jun 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Composable Sparse Fine-Tuning for Cross-Lingual Transfer | Nov 16, 2021 | Cross-Lingual TransferLanguage Modeling | —Unverified | 0 | 0 |
| Comparison Study Between Token Classification and Sequence Classification In Text Classification | Nov 25, 2022 | ClassificationLanguage Modeling | —Unverified | 0 | 0 |
| Segatron: Segment-aware Transformer for Language Modeling and Understanding | Jun 2, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| User Persona Identification and New Service Adaptation Recommendation | Nov 15, 2023 | Collaborative FilteringLanguage Modeling | —Unverified | 0 | 0 |
| Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling | Mar 23, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| ADALog: Adaptive Unsupervised Anomaly detection in Logs with Self-attention Masked Language Model | May 15, 2025 | Anomaly DetectionLanguage Modeling | —Unverified | 0 | 0 |
| Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays | Mar 30, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Self-Supervised learning with cross-modal transformers for emotion recognition | Nov 20, 2020 | Emotion RecognitionLanguage Modeling | —Unverified | 0 | 0 |
| CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising | Dec 14, 2021 | Cross-Modal RetrievalDecoder | —Unverified | 0 | 0 |
| Self-Supervised Relationship Probing | Dec 1, 2020 | Contrastive LearningLanguage Modeling | —Unverified | 0 | 0 |
| CLIMB: Curriculum Learning for Infant-inspired Model Building | Nov 15, 2023 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction | Oct 13, 2023 | Click-Through Rate PredictionLanguage Modeling | —Unverified | 0 | 0 |
| Causal Distillation for Language Models | Jan 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Capturing Topic Framing via Masked Language Modeling | Feb 7, 2023 | ArticlesLanguage Modeling | —Unverified | 0 | 0 |
| CamemBERT 2.0: A Smarter French Language Model Aged to Perfection | Nov 13, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation | Sep 28, 2020 | DecoderLanguage Modeling | —Unverified | 0 | 0 |
| BIM: Block-Wise Self-Supervised Learning with Masked Image Modeling | Nov 28, 2023 | Contrastive LearningLanguage Modeling | —Unverified | 0 | 0 |
| Shushing! Let's Imagine an Authentic Speech from the Silent Video | Mar 19, 2025 | cross-modal alignmentLanguage Modeling | —Unverified | 0 | 0 |
| BiLMa: Bidirectional Local-Matching for Text-based Person Re-identification | Sep 9, 2023 | Image to textLanguage Modeling | —Unverified | 0 | 0 |
| SimpleBERT: A Pre-trained Model That Learns to Generate Simple Words | Apr 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| VidLPRO: A Video-Language Pre-training Framework for Robotic and Laparoscopic Surgery | Sep 7, 2024 | Computational EfficiencyContrastive Learning | —Unverified | 0 | 0 |
| Small Languages, Big Models: A Study of Continual Training on Languages of Norway | Dec 9, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Bilingual Language Modeling, A transfer learning technique for Roman Urdu | Feb 22, 2021 | Cross-Lingual TransferLanguage Modeling | —Unverified | 0 | 0 |
| Solving Dialogue Grounding Embodied Task in a Simulated Environment using Further Masked Language Modeling | Jun 21, 2023 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| SoundSpring: Loss-Resilient Audio Transceiver with Dual-Functional Masked Language Modeling | Jan 22, 2025 | Audio CompressionLanguage Modeling | —Unverified | 0 | 0 |
| SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation | Oct 21, 2022 | Entity LinkingEntity Typing | —Unverified | 0 | 0 |
| CodeSSM: Towards State Space Models for Code Understanding | May 2, 2025 | Clone DetectionLanguage Modeling | —Unverified | 0 | 0 |
| Split-and-Rephrase in a Cross-Lingual Manner: A Complete Pipeline | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding | Oct 23, 2020 | cross-modal alignmentLanguage Modeling | —Unverified | 0 | 0 |
| ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation | Aug 31, 2023 | Image-text matchingLanguage Modeling | —Unverified | 0 | 0 |
| Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene | Jun 4, 2021 | Contrastive LearningData Augmentation | —Unverified | 0 | 0 |
| Adversarial Generation and Encoding of Nested Texts | Jun 1, 2019 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| STT: Soft Template Tuning for Few-Shot Learning | Jan 16, 2022 | Few-Shot LearningLanguage Modeling | —Unverified | 0 | 0 |
| STT: Soft Template Tuning for Few-Shot Adaptation | Jul 18, 2022 | Few-Shot LearningLanguage Modeling | —Unverified | 0 | 0 |
| VL-BEiT: Generative Vision-Language Pretraining | Jun 2, 2022 | image-classificationImage Classification | —Unverified | 0 | 0 |
| Bidirectional Language Models Are Also Few-shot Learners | Sep 29, 2022 | DenoisingLanguage Modeling | —Unverified | 0 | 0 |
| Bias Vector: Mitigating Biases in Language Models with Task Arithmetic Approach | Dec 16, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation | Feb 5, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |