| AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Models | Sep 9, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| TruthfulQA: Measuring How Models Mimic Human Falsehoods | Sep 8, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| PermuteFormer: Efficient Relative Position Encoding for Long Sequences | Sep 6, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Learning Hierarchical Structures with Differentiable Nondeterministic Stacks | Sep 5, 2021 | Inductive BiasLanguage Modeling | CodeCode Available | 1 |
| Data Efficient Masked Language Modeling for Vision and Language | Sep 5, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Frustratingly Simple Pretraining Alternatives to Masked Language Modeling | Sep 4, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning | Sep 2, 2021 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations | Sep 1, 2021 | Emotion ClassificationLanguage Modeling | CodeCode Available | 1 |
| -former: Infinite Memory Transformer | Sep 1, 2021 | Dialogue GenerationLanguage Modeling | CodeCode Available | 1 |
| Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognition | Aug 31, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER | Aug 31, 2021 | Cross-Lingual NERData Augmentation | CodeCode Available | 1 |
| Sentence Bottleneck Autoencoders from Transformer Language Models | Aug 31, 2021 | DecoderDenoising | CodeCode Available | 1 |
| Effective Sequence-to-Sequence Dialogue State Tracking | Aug 31, 2021 | Dialogue State TrackingLanguage Modeling | CodeCode Available | 1 |
| Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners | Aug 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Selective Differential Privacy for Language Modeling | Aug 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Want To Reduce Labeling Cost? GPT-3 Can Help | Aug 30, 2021 | Few-Shot LearningLanguage Modeling | CodeCode Available | 1 |
| Dealing with Typos for BERT-based Passage Retrieval and Ranking | Aug 27, 2021 | Information RetrievalLanguage Modeling | CodeCode Available | 1 |
| SimVLM: Simple Visual Language Model Pretraining with Weak Supervision | Aug 24, 2021 | Image CaptioningLanguage Modeling | CodeCode Available | 1 |
| From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network | Aug 22, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions | Aug 20, 2021 | Code GenerationDiversity | CodeCode Available | 1 |
| Knowledge Perceived Multi-modal Pretraining in E-commerce | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Modeling Protein Using Large-scale Pretrain Language Model | Aug 17, 2021 | Drug DiscoveryLanguage Modeling | CodeCode Available | 1 |
| Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval | Aug 12, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |