| RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining | Apr 8, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| SecureBERT: A Domain-Specific Language Model for Cybersecurity | Apr 6, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Structure-aware Protein Self-supervised Learning | Apr 6, 2022 | Graph Neural NetworkLanguage Modeling | CodeCode Available | 1 |
| IterVM: Iterative Vision Modeling Module for Scene Text Recognition | Apr 6, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| POS-BERT: Point Cloud One-Stage BERT Pre-Training | Apr 3, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation | Apr 2, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Feature Structure Distillation with Centered Kernel Alignment in BERT Transferring | Apr 1, 2022 | Knowledge DistillationLanguage Modeling | CodeCode Available | 1 |
| Monarch: Expressive Structured Matrices for Efficient and Accurate Training | Apr 1, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks | Mar 31, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Models | Mar 29, 2022 | Few-Shot LearningLanguage Modeling | CodeCode Available | 1 |
