| Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition | May 24, 2022 | Few-shot NERLanguage Modeling | CodeCode Available | 0 |
| Enhancing Continual Learning with Global Prototypes: Counteracting Negative Representation Drift | May 24, 2022 | Continual LearningLanguage Modeling | —Unverified | 0 |
| RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder | May 24, 2022 | DecoderInformation Retrieval | CodeCode Available | 2 |
| On the Role of Bidirectionality in Language Model Pre-Training | May 24, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generation | May 24, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| PERT: A New Solution to Pinyin to Character Conversion Task | May 24, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| On Measuring Social Biases in Prompt-Based Multi-Task Learning | May 23, 2022 | FormLanguage Modeling | CodeCode Available | 1 |
| Improving Short Text Classification With Augmented Data Using GPT-3 | May 23, 2022 | ClassificationLanguage Modeling | —Unverified | 0 |
| Challenges in Measuring Bias via Open-Ended Language Generation | May 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla | May 23, 2022 | Conditional Text GenerationDialogue Generation | CodeCode Available | 1 |
| The Diminishing Returns of Masked Language Models to Science | May 23, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Supporting Vision-Language Model Inference with Causality-pruning Knowledge Prompt | May 23, 2022 | Domain GeneralizationLanguage Modeling | —Unverified | 0 |
| PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models | May 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements | May 23, 2022 | DiversityLanguage Modeling | CodeCode Available | 0 |
| Prompt Tuning for Discriminative Pre-trained Language Models | May 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| The Geometry of Multilingual Language Model Representations | May 22, 2022 | Cross-Lingual TransferLanguage Modeling | CodeCode Available | 1 |
| Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models | May 22, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Housekeep: Tidying Virtual Households using Commonsense Reasoning | May 22, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Named Entity Linking with Entity Representation by Multiple Embeddings | May 21, 2022 | Entity LinkingLanguage Modeling | —Unverified | 0 |
| Scenario-based Multi-product Advertising Copywriting Generation for E-Commerce | May 21, 2022 | AttributeLanguage Modeling | —Unverified | 0 |
| DeepStruct: Pretraining of Language Models for Structure Prediction | May 21, 2022 | coreference-resolutionCoreference Resolution | CodeCode Available | 1 |
| Multilingual Normalization of Temporal Expressions with Masked Language Models | May 20, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes | May 20, 2022 | ColorizationDepth Estimation | —Unverified | 0 |
| Visually-Augmented Language Modeling | May 20, 2022 | Image RetrievalLanguage Modeling | CodeCode Available | 1 |
| KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation | May 20, 2022 | DiversityLanguage Modeling | CodeCode Available | 1 |
