| Unlocking Efficiency: Adaptive Masking for Gene Transformer Models | Aug 13, 2024 | Language ModelingLanguage Modelling | CodeCode Available | 0 | 5 |
| Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling | Apr 4, 2019 | Domain AdaptationLanguage Modeling | CodeCode Available | 0 | 5 |
| Unsupervised Improvement of Factual Knowledge in Language Models | Apr 4, 2023 | Language ModelingLanguage Modelling | CodeCode Available | 0 | 5 |
| Unsupervised Representation Learning of Player Behavioral Data with Confidence Guided Masking | Apr 25, 2022 | Feature EngineeringLanguage Modeling | CodeCode Available | 0 | 5 |
| Vision-Language Pre-Training for Boosting Scene Text Detectors | Apr 29, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 0 | 5 |
| MMCLIP: Cross-modal Attention Masked Modelling for Medical Language-Image Pre-Training | Jul 28, 2024 | Contrastive LearningLanguage Modeling | CodeCode Available | 0 | 5 |
| Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little | Apr 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Masked Language Modeling Becomes Conditional Density Estimation for Tabular Data Synthesis | May 31, 2024 | Density EstimationImputation | —Unverified | 0 | 0 |
| Towards Unified Prompt Tuning for Few-shot Learning | Nov 16, 2021 | Few-Shot LearningLanguage Modeling | —Unverified | 0 | 0 |
| A Closer Look at Parameter Contributions When Training Neural Language and Translation Models | Oct 1, 2022 | Causal Language ModelingLanguage Modeling | —Unverified | 0 | 0 |
| Absformer: Transformer-based Model for Unsupervised Multi-Document Abstractive Summarization | Jun 7, 2023 | Abstractive Text SummarizationDecoder | —Unverified | 0 | 0 |
| Masked Vision and Language Modeling for Multi-modal Representation Learning | Aug 3, 2022 | cross-modal alignmentLanguage Modeling | —Unverified | 0 | 0 |
| A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer | Dec 15, 2024 | Feature EngineeringLanguage Modeling | —Unverified | 0 | 0 |
| MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification | May 24, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Enhancing Domain-Specific Encoder Models with LLM-Generated Data: How to Leverage Ontologies, and How to Do Without Them | Mar 27, 2025 | Continual PretrainingLanguage Modeling | —Unverified | 0 | 0 |
| Maximizing Efficiency of Language Model Pre-training for Learning Representation | Oct 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Enhancing BERT-Based Visual Question Answering through Keyword-Driven Sentence Selection | Oct 13, 2023 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives | Feb 25, 2021 | Contrastive LearningLanguage Modeling | —Unverified | 0 | 0 |
| Enabling Autoregressive Models to Fill In Masked Tokens | Feb 9, 2025 | DecoderLanguage Modeling | —Unverified | 0 | 0 |
| APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning | Dec 19, 2022 | Data AugmentationLanguage Modeling | —Unverified | 0 | 0 |
| Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models | May 22, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Emerging Property of Masked Token for Effective Pre-training | Apr 12, 2024 | AttributeLanguage Modeling | —Unverified | 0 | 0 |
| Emerging Cross-lingual Structure in Pretrained Language Models | Nov 4, 2019 | Cross-Lingual TransferLanguage Modeling | —Unverified | 0 | 0 |
| MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding | Jan 23, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| MG-BERT: Multi-Graph Augmented BERT for Masked Language Modeling | Jun 1, 2021 | Knowledge GraphsLanguage Modeling | —Unverified | 0 | 0 |
| Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge | Nov 20, 2022 | Entity LinkingLanguage Modeling | —Unverified | 0 | 0 |
| MIDI-to-Tab: Guitar Tablature Inference via Masked Language Modeling | Aug 9, 2024 | DecoderLanguage Modeling | —Unverified | 0 | 0 |
| Misinformation Detection in Social Media Video Posts | Feb 15, 2022 | Contrastive LearningLanguage Modeling | —Unverified | 0 | 0 |
| Winner Team Mia at TextVQA Challenge 2021: Vision-and-Language Representation Learning with Pre-trained Sequence-to-Sequence Model | Jun 24, 2021 | DecoderLanguage Modeling | —Unverified | 0 | 0 |
| Mitigating Gender Bias in Contextual Word Embeddings | Nov 18, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Efficient Parallel Audio Generation using Group Masked Language Modeling | Jan 2, 2024 | Audio GenerationComputational Efficiency | —Unverified | 0 | 0 |
| MLIM: Vision-and-Language Model Pre-training with Masked Language and Image Modeling | Sep 24, 2021 | Image ReconstructionLanguage Modeling | —Unverified | 0 | 0 |
| Efficient Masked Autoencoders with Self-Consistency | Feb 28, 2023 | image-classificationImage Classification | —Unverified | 0 | 0 |
| Modeling Mathematical Notation Semantics in Academic Papers | Nov 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets | Apr 1, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Effective Decoder Masking for Transformer Based End-to-End Speech Recognition | Oct 27, 2020 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 | 0 |
| A Pilot Study on Dialogue-Level Dependency Parsing for Chinese | May 21, 2023 | Dependency ParsingLanguage Modeling | —Unverified | 0 | 0 |
| MST: Masked Self-Supervised Transformer for Visual Representation | Jun 10, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Mu^2SLAM: Multitask, Multilingual Speech and Language Models | Dec 19, 2022 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 | 0 |
| AntLM: Bridging Causal and Masked Language Models | Dec 4, 2024 | Causal Language ModelingDecoder | —Unverified | 0 | 0 |
| A Novel Two-Step Fine-Tuning Pipeline for Cold-Start Active Learning in Text Classification Tasks | Jul 24, 2024 | Active LearningDomain Adaptation | —Unverified | 0 | 0 |
| Multi-Modal Pre-Training for Automated Speech Recognition | Oct 12, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Dynamic Motion Synthesis: Masked Audio-Text Conditioned Spatio-Temporal Transformers | Sep 3, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| Dynamic Masking Rate Schedules for MLM Pretraining | May 24, 2023 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| N-gram Prediction and Word Difference Representations for Language Modeling | Sep 5, 2024 | Causal Language ModelingLanguage Modeling | —Unverified | 0 | 0 |
| NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection | Nov 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog | Nov 16, 2021 | dialog state trackingLanguage Modeling | —Unverified | 0 | 0 |
| Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction | Aug 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training | Apr 1, 2021 | Image-text matchingImage-text Retrieval | —Unverified | 0 | 0 |
| SkillNet-NLU: A Sparsely Activated Model for General-Purpose Natural Language Understanding | Mar 7, 2022 | Language ModellingMasked Language Modeling | —Unverified | 0 | 0 |