| Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning | Apr 21, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| On Sampling-Based Training Criteria for Neural Language Modeling | Apr 21, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| B-PROP: Bootstrapped Pre-training with Representative Words Prediction for Ad-hoc Retrieval | Apr 20, 2021 | Information RetrievalLanguage Modeling | CodeCode Available | 0 |
| BERTić -- The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian | Apr 19, 2021 | Commonsense Causal ReasoningLanguage Modeling | —Unverified | 0 |
| When FastText Pays Attention: Efficient Estimation of Word Representations using Constrained Positional Weighting | Apr 19, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training | Apr 19, 2021 | Contrastive LearningLanguage Modeling | —Unverified | 0 |
| On the Influence of Masking Policies in Intermediate Pre-training | Apr 18, 2021 | Abstractive Text SummarizationLanguage Modeling | —Unverified | 0 |
| Go Forth and Prosper: Language Modeling with Ancient Textual History | Apr 18, 2021 | ArticlesLanguage Modeling | CodeCode Available | 0 |
| Enriching a Model's Notion of Belief using a Persistent Memory | Apr 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Masked Segmental Language Model for Unsupervised Natural Language Segmentation | Apr 16, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema | Apr 16, 2021 | Artifact DetectionBias Detection | —Unverified | 0 |
| Effect of Visual Extensions on Natural Language Understanding in Vision-and-Language Models | Apr 16, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Detecting Polarized Topics Using Partisanship-aware Contextualized Topic Embeddings | Apr 15, 2021 | ArticlesLanguage Modeling | CodeCode Available | 0 |
| Bilingual alignment transfers to multilingual alignment for unsupervised parallel text mining | Apr 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models | Apr 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| SINA-BERT: A pre-trained Language Model for Analysis of Medical Texts in Persian | Apr 15, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Mean-Squared Accuracy of Good-Turing Estimator | Apr 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little | Apr 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| UDALM: Unsupervised Domain Adaptation through Language Modeling | Apr 14, 2021 | Domain AdaptationLanguage Modeling | CodeCode Available | 0 |
| IGA : An Intent-Guided Authoring Assistant | Apr 14, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Event Detection as Question Answering with Entity Information | Apr 14, 2021 | Event DetectionLanguage Modeling | CodeCode Available | 0 |
| Large-Scale Self- and Semi-Supervised Learning for Speech Translation | Apr 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition | Apr 13, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| What's in your Head? Emergent Behaviour in Multi-Task Transformer Models | Apr 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Restoring and Mining the Records of the Joseon Dynasty via Neural Language Modeling and Machine Translation | Apr 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |