| Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model | Oct 12, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| BioMegatron: Larger Biomedical Domain Language Model | Oct 12, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Extracting Angina Symptoms from Clinical Notes Using Pre-Trained Transformer Architectures | Oct 12, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Meta-Context Transformers for Domain-Specific Response Generation | Oct 12, 2020 | Dialogue GenerationLanguage Modeling | CodeCode Available | 0 |
| On the Complementary Nature of Knowledge Graph Embedding, Fine Grain Entity Types, and Language Modeling | Oct 12, 2020 | Graph EmbeddingKnowledge Graph Embedding | CodeCode Available | 0 |
| Multi-Stage Pre-training for Low-Resource Domain Adaptation | Oct 12, 2020 | Document RankingDomain Adaptation | —Unverified | 0 |
| Pre-trained Language Model Based Active Learning for Sentence Matching | Oct 12, 2020 | Active LearningLanguage Modeling | —Unverified | 0 |
| Plan ahead: Self-Supervised Text Planning for Paragraph Completion Task | Oct 11, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task | Oct 11, 2020 | Collaborative FilteringLanguage Modeling | —Unverified | 0 |
| Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU | Oct 11, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Beyond Language: Learning Commonsense from Images for Reasoning | Oct 10, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding | Oct 10, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments | Oct 10, 2020 | Dialect IdentificationLanguage Modeling | CodeCode Available | 1 |
| Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization | Oct 10, 2020 | Formality Style TransferLanguage Modeling | CodeCode Available | 0 |
| Discourse structure interacts with reference but not syntax in neural language models | Oct 10, 2020 | coreference-resolutionCoreference Resolution | CodeCode Available | 0 |
| Solving Historical Dictionary Codes with a Neural Language Model | Oct 9, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Multichannel Generative Language Model: Learning All Possible Factorizations Within and Across Channels | Oct 9, 2020 | AllDiversity | —Unverified | 0 |
| Plug-and-Play Conversational Models | Oct 9, 2020 | AttributeLanguage Modeling | CodeCode Available | 1 |
| Q-learning with Language Model for Edit-based Unsupervised Summarization | Oct 9, 2020 | Abstractive Text SummarizationDecoder | CodeCode Available | 1 |
| Style Attuned Pre-training and Parameter Efficient Fine-tuning for Spoken Language Understanding | Oct 9, 2020 | Domain AdaptationLanguage Modeling | —Unverified | 0 |
| Online Back-Parsing for AMR-to-Text Generation | Oct 9, 2020 | AMR-to-Text GenerationData-to-Text Generation | CodeCode Available | 0 |
| Tatum-Level Drum Transcription Based on a Convolutional Recurrent Neural Network with Language Model-Based Regularized Training | Oct 8, 2020 | Drum TranscriptionLanguage Modeling | —Unverified | 0 |
| Masked ELMo: An evolution of ELMo towards fully contextual RNN language models | Oct 8, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks | Oct 8, 2020 | image-classificationImage Classification | —Unverified | 0 |
| Large Product Key Memory for Pretrained Language Models | Oct 8, 2020 | Causal Language ModelingLanguage Modeling | CodeCode Available | 0 |
| Precise Task Formalization Matters in Winograd Schema Evaluations | Oct 8, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| On the importance of pre-training data volume for compact language models | Oct 8, 2020 | FQuADLanguage Modeling | —Unverified | 0 |
| A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks | Oct 7, 2020 | ClassificationGeneral Classification | —Unverified | 0 |
| Cross-Thought for Sentence Encoder Pre-training | Oct 7, 2020 | Information RetrievalLanguage Modeling | CodeCode Available | 1 |
| "I'd rather just go to bed": Understanding Indirect Answers | Oct 7, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Guiding Attention for Self-Supervised Learning with Transformers | Oct 6, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Beyond [CLS] through Ranking by Generation | Oct 6, 2020 | Answer SelectionInformation Retrieval | —Unverified | 0 |
| Learning to Represent Image and Text with Denotation Graph | Oct 6, 2020 | AttributeImage Retrieval | —Unverified | 0 |
| Keep CALM and Explore: Language Models for Action Generation in Text-based Games | Oct 6, 2020 | Action GenerationLanguage Modeling | CodeCode Available | 1 |
| Compositional Demographic Word Embeddings | Oct 6, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation | Oct 6, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Pretrained Language Model Embryology: The Birth of ALBERT | Oct 6, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Rank and run-time aware compression of NLP Applications | Oct 6, 2020 | Intent DetectionLanguage Modeling | —Unverified | 0 |
| SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding | Oct 5, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Inference Strategies for Machine Translation with Conditional Masking | Oct 5, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| GenAug: Data Augmentation for Finetuning Text Generators | Oct 5, 2020 | Data AugmentationDiversity | CodeCode Available | 1 |
| Linguistic Profiling of a Neural Language Model | Oct 5, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Pilot Study of Text-to-SQL Semantic Parsing for Vietnamese | Oct 5, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| NLP Service APIs and Models for Efficient Registration of New Clients | Oct 4, 2020 | GPULanguage Modeling | —Unverified | 0 |
| When in Doubt, Ask: Generating Answerable and Unanswerable Questions, Unsupervised | Oct 4, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles | Oct 3, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| XDA: Accurate, Robust Disassembly with Transfer Learning | Oct 2, 2020 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| SparTerm: Learning Term-based Sparse Representation for Fast Text Retrieval | Oct 2, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |
| LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention | Oct 2, 2020 | Common Sense ReasoningEntity Typing | CodeCode Available | 1 |
| Syntax Representation in Word Embeddings and Neural Networks -- A Survey | Oct 2, 2020 | Language ModelingLanguage Modelling | —Unverified | 0 |