| Profile Prediction: An Alignment-Based Pre-Training Task for Protein Sequence Models | Dec 1, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines | Jul 22, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Prompt-Guided Injection of Conformation to Pre-trained Protein Model | Feb 7, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Prompt-Learning for Fine-Grained Entity Typing | Aug 24, 2021 | Entity TypingKnowledge Probing | —Unverified | 0 |
| Prompt-Learning for Fine-Grained Entity Typing | Nov 16, 2021 | Entity TypingKnowledge Probing | —Unverified | 0 |
| Pseudo-Label Guided Unsupervised Domain Adaptation of Contextual Embeddings | Apr 1, 2021 | Domain AdaptationLanguage Modeling | —Unverified | 0 |
| Pseudo-perplexity in One Fell Swoop for Protein Fitness Estimation | Jul 9, 2024 | Computational EfficiencyLanguage Modeling | —Unverified | 0 |
| Recipes for Sequential Pre-training of Multilingual Encoder and Seq2Seq Models | Jun 14, 2023 | DecoderLanguage Modeling | —Unverified | 0 |
| Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation | Nov 1, 2022 | image-classificationImage Classification | —Unverified | 0 |
| Retrieval Augmented Language Model Pre-Training | Jan 1, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training | Oct 11, 2022 | GPUKnowledge Graphs | —Unverified | 0 |
| SCRIPT: Self-Critic PreTraining of Transformers | Jun 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Segatron: Segment-aware Transformer for Language Modeling and Understanding | Jun 2, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays | Mar 30, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Self-Supervised learning with cross-modal transformers for emotion recognition | Nov 20, 2020 | Emotion RecognitionLanguage Modeling | —Unverified | 0 |
| Self-Supervised Relationship Probing | Dec 1, 2020 | Contrastive LearningLanguage Modeling | —Unverified | 0 |
| Shushing! Let's Imagine an Authentic Speech from the Silent Video | Mar 19, 2025 | cross-modal alignmentLanguage Modeling | —Unverified | 0 |
| SimpleBERT: A Pre-trained Model That Learns to Generate Simple Words | Apr 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Small Languages, Big Models: A Study of Continual Training on Languages of Norway | Dec 9, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Solving Dialogue Grounding Embodied Task in a Simulated Environment using Further Masked Language Modeling | Jun 21, 2023 | Language ModelingLanguage Modelling | —Unverified | 0 |
| SoundSpring: Loss-Resilient Audio Transceiver with Dual-Functional Masked Language Modeling | Jan 22, 2025 | Audio CompressionLanguage Modeling | —Unverified | 0 |
| SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation | Oct 21, 2022 | Entity LinkingEntity Typing | —Unverified | 0 |
| Split-and-Rephrase in a Cross-Lingual Manner: A Complete Pipeline | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding | Oct 23, 2020 | cross-modal alignmentLanguage Modeling | —Unverified | 0 |
| STT: Soft Template Tuning for Few-Shot Learning | Jan 16, 2022 | Few-Shot LearningLanguage Modeling | —Unverified | 0 |
| STT: Soft Template Tuning for Few-Shot Adaptation | Jul 18, 2022 | Few-Shot LearningLanguage Modeling | —Unverified | 0 |
| SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining | Apr 1, 2024 | Contrastive LearningImage-text matching | —Unverified | 0 |
| TACO: Pre-training of Deep Transformers with Attention Convolution using Disentangled Positional Representation | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval | Jan 30, 2023 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Taking Actions Separately: A Bidirectionally-Adaptive Transfer Learning Method for Low-Resource Neural Machine Translation | Oct 1, 2022 | Generative Adversarial NetworkLanguage Modeling | —Unverified | 0 |
| Target-Aware Data Augmentation for Stance Detection | Jun 1, 2021 | Data AugmentationLanguage Modeling | —Unverified | 0 |
| Temporal Language Modeling for Short Text Document Classification with Transformers | Nov 16, 2021 | ClassificationDocument Classification | —Unverified | 0 |
| TemPrompt: Multi-Task Prompt Learning for Temporal Relation Extraction in RAG-based Crowdsourcing Systems | Jun 21, 2024 | Contrastive LearningLanguage Modeling | —Unverified | 0 |
| TensorCoder: Dimension-Wise Attention via Tensor Representation for Natural Language Modeling | Jul 28, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Text Style Transfer for Bias Mitigation using Masked Language Modeling | Jan 21, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives | Sep 3, 2019 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Token Dropping for Efficient BERT Pretraining | Mar 24, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE | Dec 4, 2022 | Common Sense Reasoningcoreference-resolution | —Unverified | 0 |
| Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models | Jun 4, 2024 | Document DatingLanguage Modeling | —Unverified | 0 |
| Towards Making the Most of Pre-trained Translation Model for Quality Estimation | Oct 1, 2022 | DenoisingLanguage Modeling | —Unverified | 0 |
| Towards Unified Prompt Tuning for Few-shot Learning | Nov 16, 2021 | Few-Shot LearningLanguage Modeling | —Unverified | 0 |
| Towards Unified Prompt Tuning for Few-shot Text Classification | May 11, 2022 | ClassificationFew-Shot Learning | —Unverified | 0 |
| UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training | Apr 1, 2021 | Image-text matchingImage-text Retrieval | —Unverified | 0 |
| UFO: A UniFied TransfOrmer for Vision-Language Representation Learning | Nov 19, 2021 | Image CaptioningImage-text matching | —Unverified | 0 |
| UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection | Apr 23, 2020 | Domain AdaptationGeneral Classification | —Unverified | 0 |
| Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression | Jun 1, 2023 | Contrastive LearningData Augmentation | —Unverified | 0 |
| Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training | Apr 19, 2021 | Contrastive LearningLanguage Modeling | —Unverified | 0 |
| Understanding the Natural Language of DNA using Encoder-Decoder Foundation Models with Byte-level Precision | Nov 4, 2023 | DecoderLanguage Modeling | —Unverified | 0 |
| Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training | Aug 16, 2019 | Image-text matchingImage-text Retrieval | —Unverified | 0 |
| Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation | Dec 10, 2021 | Image-text matchingImage-text Retrieval | —Unverified | 0 |