| RefineCap: Concept-Aware Refinement for Image Captioning | Sep 8, 2021 | DecoderDescriptive | —Unverified | 0 |
| Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories | Sep 8, 2021 | FormLanguage Modeling | CodeCode Available | 0 |
| NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction | Sep 8, 2021 | Entity LinkingLanguage Modeling | —Unverified | 0 |
| Sustainable Modular Debiasing of Language Models | Sep 8, 2021 | FairnessLanguage Modeling | —Unverified | 0 |
| Continuous Entailment Patterns for Lexical Inference in Context | Sep 8, 2021 | Few-Shot NLILanguage Modeling | CodeCode Available | 0 |
| Infusing Future Information into Monotonic Attention Through Language Models | Sep 7, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Generate & Rank: A Multi-task Framework for Math Word Problems | Sep 7, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Text-Free Prosody-Aware Generative Spoken Language Modeling | Sep 7, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings | Sep 7, 2021 | AllLanguage Modeling | —Unverified | 0 |
| You should evaluate your language model on marginal likelihood over tokenisations | Sep 6, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| PermuteFormer: Efficient Relative Position Encoding for Long Sequences | Sep 6, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Teaching Autoregressive Language Models Complex Tasks By Demonstration | Sep 5, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Learning Hierarchical Structures with Differentiable Nondeterministic Stacks | Sep 5, 2021 | Inductive BiasLanguage Modeling | CodeCode Available | 1 |
| Data Efficient Masked Language Modeling for Vision and Language | Sep 5, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Frustratingly Simple Pretraining Alternatives to Masked Language Modeling | Sep 4, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| No Need to Know Everything! Efficiently Augmenting Language Models With External Knowledge | Sep 3, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT | Sep 3, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Finetuned Language Models Are Zero-Shot Learners | Sep 3, 2021 | ARCCommon Sense Reasoning | CodeCode Available | 3 |
| Multimodal Conditionality for Natural Language Generation | Sep 2, 2021 | DescriptiveLanguage Modeling | —Unverified | 0 |
| Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation | Sep 2, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Skim-Attention: Learning to Focus via Document Layout | Sep 2, 2021 | document understandingLanguage Modeling | CodeCode Available | 0 |
| An Empirical Exploration in Quality Filtering of Text Data | Sep 2, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation | Sep 2, 2021 | Few-Shot LearningIntent Detection | —Unverified | 0 |
| Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning | Sep 2, 2021 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| LegaLMFiT: Efficient Short Legal Text Classification with LSTM Language Model Pre-Training | Sep 2, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| On Reducing Repetition in Abstractive Summarization | Sep 1, 2021 | Abstractive Text SummarizationInformativeness | —Unverified | 0 |
| Neural Borrowing Detection with Monolingual Lexical Models | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Towards a Language Model for Temporal Commonsense Reasoning | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Watching a Language Model Learning Chess | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Split-and-Rephrase in a Cross-Lingual Manner: A Complete Pipeline | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Unsupervised Text Style Transfer with Content Embeddings | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Domain-Specific Japanese ELECTRA Model Using a Small Corpus | Sep 1, 2021 | ArticlesComputational Efficiency | —Unverified | 0 |
| Improving Character-Aware Neural Language Model by Warming up Character Encoder under Skip-gram Architecture | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Developing a Clinical Language Model for Swedish: Continued Pretraining of Generic BERT with In-Domain Data | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Low-Resource ASR with an Augmented Language Model | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| IRCologne at GermEval 2021: Toxicity Classification | Sep 1, 2021 | ClassificationLanguage Modeling | —Unverified | 0 |
| -former: Infinite Memory Transformer | Sep 1, 2021 | Dialogue GenerationLanguage Modeling | CodeCode Available | 1 |
| CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations | Sep 1, 2021 | Emotion ClassificationLanguage Modeling | CodeCode Available | 1 |
| Does Knowledge Help General NLU? An Empirical Study | Sep 1, 2021 | Common Sense ReasoningLanguage Modeling | —Unverified | 0 |
| Masked Adversarial Generation for Neural Machine Translation | Sep 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognition | Aug 31, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| Effectiveness of Deep Networks in NLP using BiDAF as an example architecture | Aug 31, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Sentence Bottleneck Autoencoders from Transformer Language Models | Aug 31, 2021 | DecoderDenoising | CodeCode Available | 1 |
| MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER | Aug 31, 2021 | Cross-Lingual NERData Augmentation | CodeCode Available | 1 |
| Effective Sequence-to-Sequence Dialogue State Tracking | Aug 31, 2021 | Dialogue State TrackingLanguage Modeling | CodeCode Available | 1 |
| How Does Adversarial Fine-Tuning Benefit BERT? | Aug 31, 2021 | Continual LearningDependency Parsing | —Unverified | 0 |
| Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners | Aug 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Want To Reduce Labeling Cost? GPT-3 Can Help | Aug 30, 2021 | Few-Shot LearningLanguage Modeling | CodeCode Available | 1 |
| Selective Differential Privacy for Language Modeling | Aug 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| The effects of data size on Automated Essay Scoring engines | Aug 30, 2021 | Automated Essay ScoringLanguage Modeling | —Unverified | 0 |