| When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute | Feb 24, 2021 | GPULanguage Modeling | CodeCode Available | 2 |
| From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection | Feb 24, 2021 | Hate Speech DetectionLanguage Modeling | —Unverified | 0 |
| Evolutionary optimization of contexts for phonetic correction in speech recognition systems | Feb 23, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Enhanced Modality Transition for Image Captioning | Feb 23, 2021 | DecoderImage Captioning | —Unverified | 0 |
| Bilingual Language Modeling, A transfer learning technique for Roman Urdu | Feb 22, 2021 | Cross-Lingual TransferLanguage Modeling | —Unverified | 0 |
| Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model | Feb 22, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Web-based Application for Detecting Indonesian Clickbait Headlines using IndoBERT | Feb 21, 2021 | ArticlesLanguage Modeling | —Unverified | 0 |
| An Empirical Study on Measuring the Similarity of Sentential Arguments with Language Model Domain Adaptation | Feb 19, 2021 | Argument MiningClustering | —Unverified | 0 |
| Alternate Endings: Improving Prosody for Incremental Neural TTS with Predicted Future Text Input | Feb 19, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Fixing Errors of the Google Voice Recognizer through Phonetic Distance Metrics | Feb 18, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Less is More: Pre-train a Strong Text Encoder for Dense Retrieval Using a Weak Decoder | Feb 18, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
| End-to-end lyrics Recognition with Voice to Singing Style Transfer | Feb 17, 2021 | Data AugmentationLanguage Modeling | CodeCode Available | 1 |
| Do End-to-End Speech Recognition Models Care About Context? | Feb 17, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining | Feb 16, 2021 | Contrastive LearningGPU | CodeCode Available | 1 |
| Large-Context Conversational Representation Learning: Self-Supervised Learning for Conversational Documents | Feb 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training | Feb 16, 2021 | Image ClassificationLanguage Modeling | CodeCode Available | 1 |
| Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERT | Feb 15, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification | Feb 15, 2021 | ClassificationGeneral Classification | —Unverified | 0 |
| DOBF: A Deobfuscation Pre-Training Objective for Programming Languages | Feb 15, 2021 | Code SearchCode Translation | CodeCode Available | 1 |
| Reasoning Over Virtual Knowledge Bases With Open Predicate Relations | Feb 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| MSA Transformer | Feb 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| End-to-end Audio-visual Speech Recognition with Conformers | Feb 12, 2021 | Audio-Visual Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| Proof Artifact Co-training for Theorem Proving with Language Models | Feb 11, 2021 | Automated Theorem ProvingImitation Learning | CodeCode Available | 1 |
| Unsupervised Extractive Summarization using Pointwise Mutual Information | Feb 11, 2021 | ArticlesExtractive Summarization | CodeCode Available | 1 |
| Speech-language Pre-training for End-to-end Spoken Language Understanding | Feb 11, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation | Feb 10, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Customizing Contextualized Language Models forLegal Document Reviews | Feb 10, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Models | Feb 9, 2021 | DiversityEnd-To-End Dialogue Modelling | CodeCode Available | 1 |
| Improving Scene Graph Classification by Exploiting Knowledge from Texts | Feb 9, 2021 | ClassificationGeneral Classification | —Unverified | 0 |
| NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application | Feb 9, 2021 | ArticlesKnowledge Distillation | —Unverified | 0 |
| Does He Wink or Does He Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models | Feb 6, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Intermediate Loss Regularization for CTC-based Speech Recognition | Feb 5, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Understanding Emails and Drafting Responses -- An Approach Using GPT-3 | Feb 5, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models | Feb 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Unifying Vision-and-Language Tasks via Text Generation | Feb 4, 2021 | Conditional Text GenerationDecoder | CodeCode Available | 1 |
| Adaptive Semiparametric Language Models | Feb 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework | Feb 3, 2021 | ClassificationEmotion Classification | —Unverified | 0 |
| Effects of Number of Filters of Convolutional Layers on Speech Recognition Model Accuracy | Feb 3, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Mind the Gap: Assessing Temporal Generalization in Neural Language Models | Feb 3, 2021 | Language Model EvaluationLanguage Modeling | —Unverified | 0 |
| Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition | Feb 2, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Clickbait Headline Detection in Indonesian News Sites using Multilingual Bidirectional Encoder Representations from Transformers (M-BERT) | Feb 2, 2021 | Clickbait DetectionLanguage Modeling | —Unverified | 0 |
| Generative Spoken Language Modeling from Raw Audio | Feb 1, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
| End2End Acoustic to Semantic Transduction | Feb 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcript | Feb 1, 2021 | intent-classificationIntent Classification | CodeCode Available | 1 |
| SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification | Feb 1, 2021 | Language IdentificationLanguage Modeling | CodeCode Available | 0 |
| Adversarial Contrastive Pre-training for Protein Sequences | Jan 31, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Speech Recognition by Simply Fine-tuning BERT | Jan 30, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| BCN2BRNO: ASR System Fusion for Albayzin 2020 Speech to Text Challenge | Jan 29, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Explaining Natural Language Processing Classifiers with Occlusion and Language Modeling | Jan 28, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| LESA: Linguistic Encapsulation and Semantic Amalgamation Based Generalised Claim Detection from Online Content | Jan 28, 2021 | Argument MiningLanguage Modeling | CodeCode Available | 1 |