| On the Multilingual Capabilities of Very Large-Scale English Language Models | Aug 30, 2021 | Extractive Question-AnsweringFew-Shot Learning | CodeCode Available | 0 |
| Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems | Aug 28, 2021 | dialog state trackingFew-Shot Learning | CodeCode Available | 0 |
| Representation Memorization for Fast Learning New Knowledge without Forgetting | Aug 28, 2021 | image-classificationImage Classification | —Unverified | 0 |
| Exploring Retraining-Free Speech Recognition for Intra-sentential Code-Switching | Aug 27, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Dealing with Typos for BERT-based Passage Retrieval and Ranking | Aug 27, 2021 | Information RetrievalLanguage Modeling | CodeCode Available | 1 |
| Exploring the Capacity of a Large-scale Masked Language Model to Recognize Grammatical Errors | Aug 27, 2021 | Grammatical Error DetectionLanguage Modeling | —Unverified | 0 |
| Position-Invariant Truecasing with a Word-and-Character Hierarchical Recurrent Neural Network | Aug 26, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens | Aug 25, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| SimVLM: Simple Visual Language Model Pretraining with Weak Supervision | Aug 24, 2021 | Image CaptioningLanguage Modeling | CodeCode Available | 1 |
| Using BERT Encoding and Sentence-Level Language Model for Sentence Ordering | Aug 24, 2021 | Document SummarizationLanguage Modeling | —Unverified | 0 |
| Detection of Criminal Texts for the Polish State Border Guard | Aug 24, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Prompt-Learning for Fine-Grained Entity Typing | Aug 24, 2021 | Entity TypingKnowledge Probing | —Unverified | 0 |
| Reducing Exposure Bias in Training Recurrent Neural Network Transducers | Aug 24, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| UzBERT: pretraining a BERT model for Uzbek | Aug 22, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network | Aug 22, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| cushLEPOR: customising hLEPOR metric using Optuna for higher agreement with human judgments or pre-trained language model LaBSE | Aug 21, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Knowledge Perceived Multi-modal Pretraining in E-commerce | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions | Aug 20, 2021 | Code GenerationDiversity | CodeCode Available | 1 |
| Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Language Model Augmented Relevance Score | Aug 19, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Exploiting Multi-Object Relationships for Detecting Adversarial Attacks in Complex Scenes | Aug 19, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification | Aug 17, 2021 | ClassificationFew-Shot Text Classification | —Unverified | 0 |
| Deduplicating Training Data Makes Language Models Better | Aug 17, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Weakly Supervised Dataset of Fine-Grained Emotions in Portuguese | Aug 17, 2021 | Emotion RecognitionLanguage Modeling | CodeCode Available | 0 |
| Scaling Laws for Deep Learning | Aug 17, 2021 | Deep Learningimage-classification | —Unverified | 0 |
| Modeling Protein Using Large-scale Pretrain Language Model | Aug 17, 2021 | Drug DiscoveryLanguage Modeling | CodeCode Available | 1 |
| Deep Natural Language Processing for LinkedIn Search | Aug 16, 2021 | Document RankingLanguage Modeling | —Unverified | 0 |
| Autoencoders as Tools for Program Synthesis | Aug 16, 2021 | Code SummarizationLanguage Modeling | CodeCode Available | 0 |
| Towards Structured Dynamic Sparse Pre-Training of BERT | Aug 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval | Aug 12, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing | Aug 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering | Aug 11, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Transformer-based Math Language Model for Handwritten Math Expression Recognition | Aug 11, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| DEMix Layers: Disentangling Domains for Modular Language Modeling | Aug 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents | Aug 10, 2021 | Key Information ExtractionLanguage Modeling | CodeCode Available | 1 |
| BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosis | Aug 10, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Do Images really do the Talking? Analysing the significance of Images in Tamil Troll meme classification | Aug 9, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| IntenT5: Search Result Diversification using Causal Language Models | Aug 9, 2021 | Causal Language ModelingDiversity | —Unverified | 0 |
| Noisy Channel Language Model Prompting for Few-Shot Text Classification | Aug 9, 2021 | AttributeClassification | CodeCode Available | 1 |
| Language Model Evaluation in Open-ended Text Generation | Aug 8, 2021 | AttributeDiversity | —Unverified | 0 |
| Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims | Aug 8, 2021 | Fact CheckingLanguage Modeling | —Unverified | 0 |
| W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training | Aug 7, 2021 | Contrastive LearningLanguage Modeling | CodeCode Available | 3 |
| Sentence Semantic Regression for Text Generation | Aug 6, 2021 | DecoderDialogue Generation | —Unverified | 0 |
| Towards Zero-shot Language Modeling | Aug 6, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| StrucTexT: Structured Text Understanding with Multi-Modal Transformers | Aug 6, 2021 | Entity LinkingLanguage Modeling | CodeCode Available | 0 |
| Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification | Aug 5, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention | Aug 5, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Finetuning Pretrained Transformers into Variational Autoencoders | Aug 5, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
| Mitigating harm in language models with conditional-likelihood filtration | Aug 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |