| Should You Mask 15% in Masked Language Modeling? | Feb 16, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings | Feb 14, 2022 | Citation PredictionContrastive Learning | CodeCode Available | 1 |
| Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations | Feb 9, 2022 | ClusteringLanguage Modeling | CodeCode Available | 1 |
| Self-Supervised Representation Learning for Speech Using Visual Grounding and Masked Language Modeling | Feb 7, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| What Has Been Enhanced in my Knowledge-Enhanced Language Model? | Feb 2, 2022 | Graph AttentionLanguage Modeling | CodeCode Available | 1 |
| Unified Scaling Laws for Routed Language Models | Feb 2, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Regression Transformer: Concurrent sequence regression and generation for molecular language modeling | Feb 1, 2022 | Conditional Text GenerationInductive Bias | CodeCode Available | 1 |
| MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage Learning | Jan 29, 2022 | Image-text matchingLanguage Modeling | CodeCode Available | 1 |
| Neural Grapheme-to-Phoneme Conversion with Pre-trained Grapheme Models | Jan 26, 2022 | Grapheme-to-Phoneme ConversionLanguage Modeling | CodeCode Available | 1 |
| Korean-Specific Dataset for Table Question Answering | Jan 17, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |