| Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition | May 24, 2022 | Few-shot NERLanguage Modeling | CodeCode Available | 0 |
| Enhancing Continual Learning with Global Prototypes: Counteracting Negative Representation Drift | May 24, 2022 | Continual LearningLanguage Modeling | —Unverified | 0 |
| RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder | May 24, 2022 | DecoderInformation Retrieval | CodeCode Available | 2 |
| On the Role of Bidirectionality in Language Model Pre-Training | May 24, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generation | May 24, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| PERT: A New Solution to Pinyin to Character Conversion Task | May 24, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| On Measuring Social Biases in Prompt-Based Multi-Task Learning | May 23, 2022 | FormLanguage Modeling | CodeCode Available | 1 |
| Improving Short Text Classification With Augmented Data Using GPT-3 | May 23, 2022 | ClassificationLanguage Modeling | —Unverified | 0 |
| Challenges in Measuring Bias via Open-Ended Language Generation | May 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla | May 23, 2022 | Conditional Text GenerationDialogue Generation | CodeCode Available | 1 |
| The Diminishing Returns of Masked Language Models to Science | May 23, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Supporting Vision-Language Model Inference with Causality-pruning Knowledge Prompt | May 23, 2022 | Domain GeneralizationLanguage Modeling | —Unverified | 0 |
| PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models | May 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements | May 23, 2022 | DiversityLanguage Modeling | CodeCode Available | 0 |
| Prompt Tuning for Discriminative Pre-trained Language Models | May 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| The Geometry of Multilingual Language Model Representations | May 22, 2022 | Cross-Lingual TransferLanguage Modeling | CodeCode Available | 1 |
| Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models | May 22, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Housekeep: Tidying Virtual Households using Commonsense Reasoning | May 22, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Named Entity Linking with Entity Representation by Multiple Embeddings | May 21, 2022 | Entity LinkingLanguage Modeling | —Unverified | 0 |
| Scenario-based Multi-product Advertising Copywriting Generation for E-Commerce | May 21, 2022 | AttributeLanguage Modeling | —Unverified | 0 |
| DeepStruct: Pretraining of Language Models for Structure Prediction | May 21, 2022 | coreference-resolutionCoreference Resolution | CodeCode Available | 1 |
| Multilingual Normalization of Temporal Expressions with Masked Language Models | May 20, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes | May 20, 2022 | ColorizationDepth Estimation | —Unverified | 0 |
| Visually-Augmented Language Modeling | May 20, 2022 | Image RetrievalLanguage Modeling | CodeCode Available | 1 |
| KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation | May 20, 2022 | DiversityLanguage Modeling | CodeCode Available | 1 |
| Progressive Class Semantic Matching for Semi-supervised Text Classification | May 20, 2022 | General ClassificationLanguage Modeling | CodeCode Available | 0 |
| RankGen: Improving Text Generation with Large Ranking Models | May 19, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| Foundation Posteriors for Approximate Probabilistic Inference | May 19, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models | May 19, 2022 | Cloud ComputingGPU | —Unverified | 0 |
| Automatic Spoken Language Identification using a Time-Delay Neural Network | May 19, 2022 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Are Prompt-based Models Clueless? | May 19, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| GPoeT-2: A GPT-2 Based Poem Generator | May 18, 2022 | DiversityLanguage Modeling | CodeCode Available | 0 |
| Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT | May 17, 2022 | Cross-Lingual TransferLanguage Modeling | —Unverified | 0 |
| TiBERT: Tibetan Pre-trained Language Model | May 15, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain | May 13, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Bootstrapping Text Anonymization Models with Distant Supervision | May 13, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Controlling Translation Formality Using Pre-trained Multilingual Language Models | May 13, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages | May 13, 2022 | Graph AttentionLanguage Modeling | CodeCode Available | 1 |
| Weakly Supervised Text Classification using Supervision Signals from a Language Model | May 13, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Localized Vision-Language Matching for Open-vocabulary Object Detection | May 12, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Efficient and Training-Free Control of Language Generation | May 12, 2022 | AttributeDiversity | —Unverified | 0 |
| AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling | May 12, 2022 | Conditional Text GenerationDecoder | CodeCode Available | 1 |
| A Generalist Agent | May 12, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Towards the Generation of Musical Explanations with GPT-3 | May 11, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Towards Unified Prompt Tuning for Few-shot Text Classification | May 11, 2022 | ClassificationFew-Shot Learning | —Unverified | 0 |
| An Empirical Study Of Self-supervised Learning Approaches For Object Detection With Transformers | May 11, 2022 | image-classificationImage Classification | CodeCode Available | 0 |
| Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification | May 11, 2022 | ClassificationFact Checking | —Unverified | 0 |
| DistilProtBert: A distilled protein language model used to distinguish between real proteins and their randomly shuffled counterparts | May 10, 2022 | Dimensionality ReductionKnowledge Distillation | CodeCode Available | 1 |
| From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective | May 10, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Human Language Modeling | May 10, 2022 | Age EstimationLanguage Modeling | CodeCode Available | 1 |