Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Sep 27, 2021 Contrastive Learning Language Modelling
Code Code Available 1Extracting and Inferring Personal Attributes from Dialogue Sep 26, 2021 Attribute Language Modeling
Code Code Available 1XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge Sep 26, 2021 Language Modeling Language Modelling
Code Code Available 1DziriBERT: a Pre-trained Language Model for the Algerian Dialect Sep 25, 2021 Language Modeling Language Modelling
Code Code Available 1Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Sep 23, 2021 Factual probe Language Modeling
Code Code Available 1Pix2seq: A Language Modeling Framework for Object Detection Sep 22, 2021 Language Modeling Language Modelling
Code Code Available 1Small-Bench NLP: Benchmark for small single GPU trained models in Natural Language Processing Sep 22, 2021 GPU Language Modelling
Code Code Available 1TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models Sep 21, 2021 Handwritten Text Recognition Language Modeling
Code Code Available 1JobBERT: Understanding Job Titles through Skills Sep 20, 2021 Language Modeling Language Modelling
Code Code Available 1Distilling Linguistic Context for Language Model Compression Sep 17, 2021 Knowledge Distillation Language Modeling
Code Code Available 1Generative Pre-Training from Molecules Sep 16, 2021 Feature Engineering General Knowledge
Code Code Available 1Context-NER : Contextual Phrase Generation at Scale Sep 16, 2021 ContextNER Language Modelling
Code Code Available 1KnowMAN: Weakly Supervised Multinomial Adversarial Networks Sep 16, 2021 Language Modeling Language Modelling
Code Code Available 1Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Sep 15, 2021 Language Modeling Language Modelling
Code Code Available 1Dialogue State Tracking with a Language Model using Schema-Driven Prompting Sep 15, 2021 Dialogue State Tracking Language Modeling
Code Code Available 1SupCL-Seq: Supervised Contrastive Learning for Downstream Optimized Sequence Representations Sep 15, 2021 CoLA Contrastive Learning
Code Code Available 1Types of Out-of-Distribution Texts and How to Detect Them Sep 14, 2021 Density Estimation Language Modeling
Code Code Available 1LM-Critic: Language Models for Unsupervised Grammatical Error Correction Sep 14, 2021 Grammatical Error Correction Language Modeling
Code Code Available 1Rationales for Sequential Predictions Sep 14, 2021 Combinatorial Optimization Language Modeling
Code Code Available 1Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning Sep 13, 2021 Language Modeling Language Modelling
Code Code Available 1Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models Sep 13, 2021 Data Augmentation Diversity
Code Code Available 1xGQA: Cross-Lingual Visual Question Answering Sep 13, 2021 Cross-Lingual Transfer Language Modeling
Code Code Available 1CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation Sep 13, 2021 Decoder Denoising
Code Code Available 1TEASEL: A Transformer-Based Speech-Prefixed Language Model Sep 12, 2021 Language Modeling Language Modelling
Code Code Available 1IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization Sep 10, 2021 Language Modeling Language Modelling
Code Code Available 1Euphemistic Phrase Detection by Masked Language Model Sep 10, 2021 Language Modeling Language Modelling
Code Code Available 1Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training Sep 10, 2021 Language Modeling Language Modelling
Code Code Available 1Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers Sep 9, 2021 Diagnostic Language Modelling
Code Code Available 1Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning Sep 9, 2021 Language Modeling Language Modelling
Code Code Available 1Efficient Nearest Neighbor Language Models Sep 9, 2021 Domain Adaptation Language Modeling
Code Code Available 1AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Models Sep 9, 2021 Language Modeling Language Modelling
Code Code Available 1KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs Sep 9, 2021 Common Sense Reasoning Language Modelling
Code Code Available 1Debiasing Methods in Natural Language Understanding Make Bias More Accessible Sep 9, 2021 Language Modeling Language Modelling
Code Code Available 1Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach Sep 9, 2021 Language Modelling
Code Code Available 1BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation Sep 9, 2021 de-en Language Modeling
Code Code Available 1TruthfulQA: Measuring How Models Mimic Human Falsehoods Sep 8, 2021 Language Modeling Language Modelling
Code Code Available 1It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books Sep 8, 2021 Answer Generation Data Augmentation
Code Code Available 1Text-to-Table: A New Way of Information Extraction Sep 6, 2021 Language Modelling Relation Extraction
Code Code Available 1PermuteFormer: Efficient Relative Position Encoding for Long Sequences Sep 6, 2021 Language Modeling Language Modelling
Code Code Available 1Data Efficient Masked Language Modeling for Vision and Language Sep 5, 2021 Language Modeling Language Modelling
Code Code Available 1Learning Hierarchical Structures with Differentiable Nondeterministic Stacks Sep 5, 2021 Inductive Bias Language Modeling
Code Code Available 1Frustratingly Simple Pretraining Alternatives to Masked Language Modeling Sep 4, 2021 Language Modeling Language Modelling
Code Code Available 1Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning Sep 2, 2021 Contrastive Learning Language Modeling
Code Code Available 1-former: Infinite Memory Transformer Sep 1, 2021 Dialogue Generation Language Modeling
Code Code Available 1ReMeDi: Resources for Multi-domain, Multi-service, Medical Dialogues Sep 1, 2021 Benchmarking Contrastive Learning
Code Code Available 1CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations Sep 1, 2021 Emotion Classification Language Modeling
Code Code Available 1DILBERT: Customized Pre-Training for Domain Adaptation withCategory Shift, with an Application to Aspect Extraction Sep 1, 2021 Aspect Extraction Domain Adaptation
Code Code Available 1Sentence Bottleneck Autoencoders from Transformer Language Models Aug 31, 2021 Decoder Denoising
Code Code Available 1Efficient conformer: Progressive downsampling and grouped attention for automatic speech recognition Aug 31, 2021 Automatic Speech Recognition Automatic Speech Recognition (ASR)
Code Code Available 1MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER Aug 31, 2021 Cross-Lingual NER Data Augmentation
Code Code Available 1