| Evaluating Distributional Distortion in Neural Language Modeling | Mar 24, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5) | Mar 24, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Mix and Match: Learning-free Controllable Text Generation using Energy Language Models | Mar 24, 2022 | AttributeLanguage Modeling | CodeCode Available | 1 |
| Multi-armed bandits for resource efficient, online optimization of language model pre-training: the use case of dynamic masking | Mar 24, 2022 | Bayesian OptimizationDecision Making | CodeCode Available | 0 |
| Token Dropping for Efficient BERT Pretraining | Mar 24, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| What to Hide from Your Students: Attention-Guided Masked Image Modeling | Mar 23, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Prompt-based System for Personality and Interpersonal Reactivity Prediction | Mar 23, 2022 | Data AugmentationLanguage Modeling | —Unverified | 0 |
| Linearizing Transformer with Key-Value Memory | Mar 23, 2022 | Abstractive Text SummarizationLanguage Modeling | —Unverified | 0 |
| HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigation | Mar 22, 2022 | Decision MakingLanguage Modeling | CodeCode Available | 1 |
| Towards Textual Out-of-Domain Detection without In-Domain Labels | Mar 22, 2022 | Contrastive Learningintent-classification | —Unverified | 0 |
| Better Language Model with Hypernym Class Prediction | Mar 21, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Language modeling via stochastic processes | Mar 21, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| TCM-SD: A Benchmark for Probing Syndrome Differentiation via Natural Language Processing | Mar 21, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| How does the pre-training objective affect what large language models learn about linguistic properties? | Mar 20, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Immersive Text Game and Personality Classification | Mar 20, 2022 | ClassificationLanguage Modeling | —Unverified | 0 |
| Distinguishing Non-natural from Natural Adversarial Samples for More Robust Pre-trained Language Model | Mar 19, 2022 | Data AugmentationLanguage Modeling | CodeCode Available | 0 |
| Dependency-based Mixture Language Models | Mar 19, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information | Mar 17, 2022 | Extractive SummarizationExtractive Text Summarization | —Unverified | 0 |
| Universal Conditional Masked Language Pre-training for Neural Machine Translation | Mar 17, 2022 | DecoderLanguage Modeling | —Unverified | 0 |
| Triangular Transfer: Freezing the Pivot for Triangular Machine Translation | Mar 17, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction | Mar 17, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| TA-SBERT: Token Attention Sentence-BERT for Improving Sentence Representation | Mar 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Linking Theories and Methods in Cognitive Sciences via Joint Embedding of the Scientific Literature: The Example of Cognitive Control | Mar 16, 2022 | Graph EmbeddingLanguage Modeling | CodeCode Available | 0 |
| Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure | Mar 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| In-Context Learning for Few-Shot Dialogue State Tracking | Mar 16, 2022 | Dialogue State TrackingFew-Shot Learning | CodeCode Available | 1 |
| KinyaBERT: a Morphology-aware Kinyarwanda Language Model | Mar 16, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Geographic Adaptation of Pretrained Language Models | Mar 16, 2022 | Language IdentificationLanguage Modeling | CodeCode Available | 0 |
| Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data | Mar 16, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Memorizing Transformers | Mar 16, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Evaluating the Text-to-SQL Capabilities of Large Language Models | Mar 15, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation | Mar 15, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost | Mar 15, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| Representation Learning for Resource-Constrained Keyphrase Generation | Mar 15, 2022 | DenoisingDomain Adaptation | CodeCode Available | 1 |
| UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQL | Mar 15, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| ReACC: A Retrieval-Augmented Code Completion Framework | Mar 15, 2022 | Code CompletionLanguage Modeling | CodeCode Available | 1 |
| PERT: Pre-training BERT with Permuted Language Model | Mar 14, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| CoNTACT: A Dutch COVID-19 Adapted BERT for Vaccine Hesitancy and Argumentation Detection | Mar 14, 2022 | AllDomain Adaptation | —Unverified | 0 |
| Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer | Mar 14, 2022 | Image CaptioningLanguage Modeling | —Unverified | 0 |
| Efficient Language Modeling with Sparse all-MLP | Mar 14, 2022 | AllCommon Sense Reasoning | —Unverified | 0 |
| Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation | Mar 12, 2022 | Image CaptioningKnowledge Distillation | —Unverified | 0 |
| Block-Recurrent Transformers | Mar 11, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Are discrete units necessary for Spoken Language Modeling? | Mar 11, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Compilable Neural Code Generation with Compiler Feedback | Mar 10, 2022 | Code CompletionCode Generation | —Unverified | 0 |
| MVP: Multimodality-guided Visual Pre-training | Mar 10, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Sentence-Select: Large-Scale Language Model Data Selection for Rare-Word Speech Recognition | Mar 9, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks | Mar 9, 2022 | Decision MakingExplainable artificial intelligence | CodeCode Available | 1 |
| HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural Language Processing | Mar 9, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A practical framework for multi-domain speech recognition and an instance sampling method to neural language modeling | Mar 9, 2022 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| LEMON: LanguagE ModeL for Negative Sampling of Knowledge Graph Embeddings | Mar 9, 2022 | Graph EmbeddingKnowledge Graph Embedding | —Unverified | 0 |
| Pretrained Domain-Specific Language Model for General Information Retrieval Tasks in the AEC Domain | Mar 9, 2022 | Information RetrievalLanguage Modeling | CodeCode Available | 1 |