| How to Train BERT with an Academic Budget | Apr 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extraction | Apr 15, 2021 | Dialog Relation ExtractionLanguage Modeling | CodeCode Available | 1 |
| TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning | Apr 14, 2021 | DenoisingDomain Adaptation | CodeCode Available | 1 |
| K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce | Apr 14, 2021 | DecoderKnowledge Base Completion | CodeCode Available | 1 |
| Learning How to Ask: Querying LMs with Mixtures of Soft Prompts | Apr 14, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Paragraph-level Simplification of Medical Texts | Apr 12, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
| On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies | Apr 12, 2021 | Inductive BiasLanguage Modeling | CodeCode Available | 1 |
| Revisiting Simple Neural Probabilistic Language Models | Apr 8, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| AlephBERT:A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application With | Apr 8, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Librispeech Transducer Model with Internal Language Model Prior Correction | Apr 7, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| MMBERT: Multimodal BERT Pretraining for Improved Medical VQA | Apr 3, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| NewsMTSC: A Dataset for (Multi-)Target-dependent Sentiment Classification in Political News Articles | Apr 1, 2021 | ArticlesDecision Making | CodeCode Available | 1 |
| Controllable Generation from Pre-trained Language Models via Inverse Prompting | Mar 19, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation | Mar 18, 2021 | Bilingual Lexicon InductionLanguage Modeling | CodeCode Available | 1 |
| Structure Inducing Pre-Training | Mar 18, 2021 | DescriptiveInductive Bias | CodeCode Available | 1 |
| Inductive Relation Prediction by BERT | Mar 12, 2021 | Few-Shot LearningInductive Learning | CodeCode Available | 1 |
| MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding | Mar 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models | Mar 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition | Mar 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services | Mar 3, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP | Feb 28, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Chess as a Testbed for Language Model State Tracking | Feb 26, 2021 | Game of ChessLanguage Modeling | CodeCode Available | 1 |
| ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning | Feb 25, 2021 | Language Model EvaluationLanguage Modeling | CodeCode Available | 1 |
| Less is More: Pre-train a Strong Text Encoder for Dense Retrieval Using a Weak Decoder | Feb 18, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
| End-to-end lyrics Recognition with Voice to Singing Style Transfer | Feb 17, 2021 | Data AugmentationLanguage Modeling | CodeCode Available | 1 |
