| Word-Free Spoken Language Understanding for Mandarin-Chinese | Jul 1, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| XLM-E: Cross-lingual Language Model Pre-training via ELECTRA | Jun 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information | Jun 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| A Simple and Efficient Probabilistic Language model for Code-Mixed Text | Jun 29, 2021 | Information RetrievalLanguage Identification | —Unverified | 0 |
| A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models | Jun 28, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| R-Drop: Regularized Dropout for Neural Networks | Jun 28, 2021 | Abstractive Text Summarizationimage-classification | CodeCode Available | 1 |
| Stabilizing Equilibrium Models by Jacobian Regularization | Jun 28, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Visual Conceptual Blending with Large-scale Language and Vision Models | Jun 27, 2021 | Image GenerationLanguage Modeling | —Unverified | 0 |
| SymbolicGPT: A Generative Transformer Model for Symbolic Regression | Jun 27, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Multimodal Few-Shot Learning with Frozen Language Models | Jun 25, 2021 | Few-Shot LearningLanguage Modeling | —Unverified | 0 |
| Learning to Sample Replacements for ELECTRA Pre-Training | Jun 25, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Language Models are Good Translators | Jun 25, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Winner Team Mia at TextVQA Challenge 2021: Vision-and-Language Representation Learning with Pre-trained Sequence-to-Sequence Model | Jun 24, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpus | Jun 24, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Multi-objective Asynchronous Successive Halving | Jun 23, 2021 | FairnessHyperparameter Optimization | CodeCode Available | 3 |
| CharacterChat: Supporting the Creation of Fictional Characters through Conversation and Progressive Manifestation with a Chatbot | Jun 23, 2021 | ChatbotLanguage Modeling | —Unverified | 0 |
| Combining Analogy with Language Models for Knowledge Extraction | Jun 22, 2021 | ArticlesLanguage Modeling | CodeCode Available | 0 |
| A Case Study in Bootstrapping Ontology Graphs from Textbooks | Jun 22, 2021 | Knowledge GraphsLanguage Modeling | —Unverified | 0 |
| Prompt Tuning or Fine-Tuning - Investigating Relational Knowledge in Pre-Trained Language Models | Jun 22, 2021 | fill-maskFill Mask | CodeCode Available | 0 |
| Data Augmentation for Opcode Sequence Based Malware Detection | Jun 22, 2021 | Android Malware DetectionData Augmentation | —Unverified | 0 |
| End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Management | Jun 22, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Ad Text Classification with Transformer-Based Natural Language Processing Methods | Jun 21, 2021 | ClassificationLanguage Modeling | —Unverified | 0 |
| CLIP2Video: Mastering Video-Text Retrieval via Image CLIP | Jun 21, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| A Discriminative Entity-Aware Language Model for Virtual Assistants | Jun 21, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| A Brief Study on the Effects of Training Generative Dialogue Models with a Semantic loss | Jun 20, 2021 | DiversityLanguage Modeling | CodeCode Available | 0 |
| MaxUp: Lightweight Adversarial Training With Data Augmentation Improves Neural Network Training | Jun 19, 2021 | Data Augmentationimage-classification | —Unverified | 0 |
| Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasets | Jun 18, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| SPBERT: An Efficient Pre-training BERT on SPARQL Queries for Question Answering over Knowledge Graphs | Jun 18, 2021 | DecoderKnowledge Graphs | CodeCode Available | 1 |
| Golos: Russian Dataset for Speech Research | Jun 18, 2021 | Automatic Speech Recognition (ASR)Language Modeling | CodeCode Available | 1 |
| BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models | Jun 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Label prompt for multi-label text classification | Jun 18, 2021 | ClassificationLanguage Modeling | —Unverified | 0 |
| Distributed Deep Learning in Open Collaborations | Jun 18, 2021 | Deep LearningLanguage Modeling | CodeCode Available | 1 |
| On Anytime Learning at Macroscale | Jun 17, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Augmented Neural Story Generation with Commonsense Inference | Jun 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Discrete Auto-regressive Variational Attention Models for Text Modeling | Jun 16, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| SEOVER: Sentence-level Emotion Orientation Vector based Conversation Emotion Recognition Model | Jun 16, 2021 | Emotion RecognitionLanguage Modeling | —Unverified | 0 |
| Scene Transformer: A unified architecture for predicting multiple agent trajectories | Jun 15, 2021 | Autonomous DrivingLanguage Modeling | CodeCode Available | 1 |
| ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling | Jun 15, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Dialectal Speech Recognition and Translation of Swiss German Speech to Standard German Text: Microsoft's Submission to SwissText 2021 | Jun 15, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Direction is what you need: Improving Word Embedding Compression in Large Language Models | Jun 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| PairConnect: A Compute-Efficient MLP Alternative to Attention | Jun 15, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Overcoming Domain Mismatch in Low Resource Sequence-to-Sequence ASR Models using Hybrid Generated Pseudotranscripts | Jun 14, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| SAS: Self-Augmentation Strategy for Language Model Pre-training | Jun 14, 2021 | Data AugmentationLanguage Modeling | CodeCode Available | 0 |
| Is Einstein more agreeable and less neurotic than Hitler? A computational exploration of the emotional and personality profiles of historical persons | Jun 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Differentiable Neural Architecture Search with Morphism-based Transformable Backbone Architectures | Jun 14, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Incorporating External POS Tagger for Punctuation Restoration | Jun 12, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| Predicting the Ordering of Characters in Japanese Historical Documents | Jun 12, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| BioELECTRA:Pretrained Biomedical text Encoder using Discriminators | Jun 11, 2021 | ArticlesLanguage Modeling | CodeCode Available | 1 |
| Leveraging Pre-trained Language Model for Speech Sentiment Analysis | Jun 11, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment | Jun 11, 2021 | DenoisingLanguage Modeling | CodeCode Available | 1 |