| Scaling Laws for Deep Learning | Aug 17, 2021 | Deep Learningimage-classification | —Unverified | 0 |
| Modeling Protein Using Large-scale Pretrain Language Model | Aug 17, 2021 | Drug DiscoveryLanguage Modeling | CodeCode Available | 1 |
| Deep Natural Language Processing for LinkedIn Search | Aug 16, 2021 | Document RankingLanguage Modeling | —Unverified | 0 |
| Autoencoders as Tools for Program Synthesis | Aug 16, 2021 | Code SummarizationLanguage Modeling | CodeCode Available | 0 |
| Towards Structured Dynamic Sparse Pre-Training of BERT | Aug 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval | Aug 12, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing | Aug 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering | Aug 11, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Transformer-based Math Language Model for Handwritten Math Expression Recognition | Aug 11, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| DEMix Layers: Disentangling Domains for Modular Language Modeling | Aug 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents | Aug 10, 2021 | Key Information ExtractionLanguage Modeling | CodeCode Available | 1 |
| BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosis | Aug 10, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Do Images really do the Talking? Analysing the significance of Images in Tamil Troll meme classification | Aug 9, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| IntenT5: Search Result Diversification using Causal Language Models | Aug 9, 2021 | Causal Language ModelingDiversity | —Unverified | 0 |
| Noisy Channel Language Model Prompting for Few-Shot Text Classification | Aug 9, 2021 | AttributeClassification | CodeCode Available | 1 |
| Language Model Evaluation in Open-ended Text Generation | Aug 8, 2021 | AttributeDiversity | —Unverified | 0 |
| Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims | Aug 8, 2021 | Fact CheckingLanguage Modeling | —Unverified | 0 |
| W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training | Aug 7, 2021 | Contrastive LearningLanguage Modeling | CodeCode Available | 3 |
| Sentence Semantic Regression for Text Generation | Aug 6, 2021 | DecoderDialogue Generation | —Unverified | 0 |
| Towards Zero-shot Language Modeling | Aug 6, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| StrucTexT: Structured Text Understanding with Multi-Modal Transformers | Aug 6, 2021 | Entity LinkingLanguage Modeling | CodeCode Available | 0 |
| Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification | Aug 5, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention | Aug 5, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Finetuning Pretrained Transformers into Variational Autoencoders | Aug 5, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
| Mitigating harm in language models with conditional-likelihood filtration | Aug 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
