| LMSOC: An approach for socially sensitive pretraining | May 22, 2021 | Cloze TestGraph Representation Learning | —Unverified | 0 |
| Scatterbrain: Unifying Sparse and Low-rank Attention | May 21, 2021 | Image GenerationLanguage Modeling | CodeCode Available | 1 |
| Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining | May 21, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learning | May 21, 2021 | Cross-Lingual Word EmbeddingsFew-Shot Learning | —Unverified | 0 |
| GapPredict: A Language Model for Resolving Gaps in Draft Genome Assemblies | May 21, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding | May 20, 2021 | Action SegmentationLanguage Modeling | —Unverified | 0 |
| Accelerating Gossip SGD with Periodic Global Averaging | May 19, 2021 | image-classificationImage Classification | —Unverified | 0 |
| Effective Attention Sheds Light On Interpretability | May 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Text based personality prediction from multiple social media data sources using pre-trained language model and model averaging | May 17, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Stage-wise Fine-tuning for Graph-to-Text Generation | May 17, 2021 | Data-to-Text GenerationKB-to-Language Generation | CodeCode Available | 1 |
| Sentence Similarity Based on Contexts | May 17, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Neural Predictive Text for Grammatical Error Prevention | May 16, 2021 | Grammatical Error CorrectionLanguage Modeling | —Unverified | 0 |
| SINA-BERT: A Pre-Trained Language Model for Analysis of Medical Texts in Persian | May 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Doc2Dict: Information Extraction as Text Generation | May 16, 2021 | GPULanguage Modeling | CodeCode Available | 0 |
| A Cognitive Regularizer for Language Modeling | May 15, 2021 | Inductive BiasLanguage Modeling | —Unverified | 0 |
| From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding | May 15, 2021 | intent-classificationIntent Classification | CodeCode Available | 0 |
| RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling | May 14, 2021 | Dialogue GenerationLanguage Modeling | CodeCode Available | 1 |
| Not All Memories are Created Equal: Learning to Forget by Expiring | May 13, 2021 | AllLanguage Modeling | CodeCode Available | 1 |
| Towards Human-Free Automatic Quality Evaluation of German Summarization | May 13, 2021 | InformativenessLanguage Modeling | —Unverified | 0 |
| MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation | May 12, 2021 | Adversarial TextData Augmentation | CodeCode Available | 1 |
| Slower is Better: Revisiting the Forgetting Mechanism in LSTM for Slower Information Decay | May 12, 2021 | image-classificationImage Classification | —Unverified | 0 |
| BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies? | May 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Matching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning | May 10, 2021 | Image Paragraph CaptioningLanguage Modeling | CodeCode Available | 0 |
| DocSCAN: Unsupervised Text Classification via Learning from Neighbors | May 9, 2021 | ClassificationClustering | CodeCode Available | 1 |
| Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents | May 9, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Understanding by Understanding Not: Modeling Negation in Language Models | May 7, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts | May 7, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer | May 6, 2021 | Data AugmentationDecoder | CodeCode Available | 1 |
| Computer-Aided Design as Language | May 6, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish | May 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning | May 4, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Impact of Gender Debiased Word Embeddings in Language Modeling | May 3, 2021 | FairnessLanguage Modeling | —Unverified | 0 |
| Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review | May 3, 2021 | Active LearningLanguage Modeling | —Unverified | 0 |
| On the limit of English conversational speech recognition | May 3, 2021 | DecoderEnglish Conversational Speech Recognition | —Unverified | 0 |
| Unsupervised Document Expansion for Information Retrieval with Stochastic Text Generation | May 3, 2021 | Information RetrievalLanguage Modeling | CodeCode Available | 0 |
| Larger-Scale Transformers for Multilingual Masked Language Modeling | May 2, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| It’s Basically the Same Language Anyway: the Case for a Nordic Language Model | May 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Error Analysis of using BART for Multi-Document Summarization: A Study for English and German Language | May 1, 2021 | Document SummarizationLanguage Modeling | CodeCode Available | 0 |
| Measuring Translationese across Levels of Expertise: Are Professionals more Surprising than Students? | May 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| When to Fold'em: How to answer Unanswerable questions | May 1, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| The Zero Resource Speech Challenge 2021: Spoken language modelling | Apr 29, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Extractive and Abstractive Explanations for Fact-Checking and Evaluation of News | Apr 27, 2021 | Fact CheckingLanguage Modeling | —Unverified | 0 |
| Diverse Image Inpainting with Bidirectional and Autoregressive Transformers | Apr 26, 2021 | DiversityImage Inpainting | —Unverified | 0 |
| Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis | Apr 26, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Teaching a Massive Open Online Course on Natural Language Processing | Apr 26, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Reranking Machine Translation Hypotheses with Structured and Web-based Language Models | Apr 25, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Learning Passage Impacts for Inverted Indexes | Apr 24, 2021 | Information RetrievalLanguage Modeling | CodeCode Available | 1 |
| Transfer training from smaller language model | Apr 23, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Fast Text-Only Domain Adaptation of RNN-Transducer Prediction Network | Apr 22, 2021 | Domain AdaptationLanguage Modeling | —Unverified | 0 |
| Extracting Adverse Drug Events from Clinical Notes | Apr 21, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |