| KALA: Knowledge-Augmented Language Model Adaptation | Apr 22, 2022 | Domain AdaptationGeneral Knowledge | CodeCode Available | 1 |
| Sparsely-gated Mixture-of-Expert Layers for CNN Interpretability | Apr 22, 2022 | image-classificationImage Classification | —Unverified | 0 |
| Taygete at SemEval-2022 Task 4: RoBERTa based models for detecting Patronising and Condescending Language | Apr 22, 2022 | ArticlesLanguage Modeling | —Unverified | 0 |
| Locally Aggregated Feature Attribution on Natural Language Model Understanding | Apr 22, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| WaBERT: A Low-resource End-to-end Model for Spoken Language Understanding and Speech-to-BERT Alignment | Apr 22, 2022 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings | Apr 21, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 2 |
| Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing | Apr 21, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 0 |
| On the Representation Collapse of Sparse Mixture of Experts | Apr 20, 2022 | ClusteringLanguage Modeling | —Unverified | 0 |
| When Does Syntax Mediate Neural Language Model Performance? Evidence from Dropout Probes | Apr 20, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Detecting Unintended Memorization in Language-Model-Fused ASR | Apr 20, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks | Apr 19, 2022 | DecoderLanguage Modeling | —Unverified | 0 |
| DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation | Apr 19, 2022 | Dialogue GenerationKnowledge Distillation | CodeCode Available | 1 |
| Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion | Apr 19, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Context-Aware Language Modeling for Goal-Oriented Dialogue Systems | Apr 18, 2022 | Goal-Oriented Dialogue SystemsLanguage Modeling | —Unverified | 0 |
| LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking | Apr 18, 2022 | cross-modal alignmentDocument AI | CodeCode Available | 0 |
| UMass PCL at SemEval-2022 Task 4: Pre-trained Language Model Ensembles for Detecting Patronizing and Condescending Language | Apr 18, 2022 | Binary ClassificationData Augmentation | —Unverified | 0 |
| StableMoE: Stable Routing Strategy for Mixture of Experts | Apr 18, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Zero-shot Entity and Tweet Characterization with Designed Conditional Prompts and Contexts | Apr 18, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| WordAlchemy: A transformer-based Reverse Dictionary | Apr 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| SimpleBERT: A Pre-trained Model That Learns to Generate Simple Words | Apr 16, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| BLCU-ICALL at SemEval-2022 Task 1: Cross-Attention Multitasking Framework for Definition Modeling | Apr 16, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Contrastive Learning with Hard Negative Entities for Entity Set Expansion | Apr 16, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| LaMemo: Language Modeling with Look-Ahead Memory | Apr 15, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Improving Passage Retrieval with Zero-Shot Question Generation | Apr 15, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Text Revision by On-the-Fly Representation Optimization | Apr 15, 2022 | AttributeLanguage Modeling | CodeCode Available | 0 |
| Evaluation Benchmarks for Spanish Sentence Representations | Apr 15, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Generative power of a protein language model trained on multiple sequence alignments | Apr 14, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| GPT-NeoX-20B: An Open-Source Autoregressive Language Model | Apr 14, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model | Apr 14, 2022 | DiversityLanguage Modeling | —Unverified | 0 |
| Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification | Apr 13, 2022 | Few-Shot Text ClassificationLanguage Modeling | CodeCode Available | 1 |
| Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding | Apr 13, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| GAP: A Graph-aware Language Model Framework for Knowledge Graph-to-Text Generation | Apr 13, 2022 | Data-to-Text GenerationGraph Attention | CodeCode Available | 1 |
| HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection | Apr 13, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change | Apr 12, 2022 | Change DetectionLanguage Modeling | —Unverified | 0 |
| What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? | Apr 12, 2022 | DecoderLanguage Modeling | CodeCode Available | 1 |
| Mining Logical Event Schemas From Pre-Trained Language Models | Apr 12, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis | Apr 11, 2022 | Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA) | CodeCode Available | 1 |
| Adapting BigScience Multilingual Model to Unseen Languages | Apr 11, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling | Apr 11, 2022 | Contrastive LearningLanguage Modeling | —Unverified | 0 |
| Breaking Character: Are Subwords Good Enough for MRLs After All? | Apr 10, 2022 | AllExtractive Question-Answering | —Unverified | 0 |
| Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features | Apr 10, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Data Augmentation for Biomedical Factoid Question Answering | Apr 10, 2022 | Data AugmentationInformation Retrieval | CodeCode Available | 0 |
| Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model | Apr 9, 2022 | BenchmarkingLanguage Modeling | —Unverified | 0 |
| IDPG: An Instance-Dependent Prompt Generation Method | Apr 9, 2022 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Contextual Representation Learning beyond Masked Language Modeling | Apr 8, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Enhance Incomplete Utterance Restoration by Joint Learning Token Extraction and Text Generation | Apr 8, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model | Apr 8, 2022 | Entity LinkingLanguage Modeling | CodeCode Available | 1 |
| Fair and Argumentative Language Modeling for Computational Argumentation | Apr 8, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Characterizing and Understanding the Behavior of Quantized Models for Reliable Deployment | Apr 8, 2022 | Image to textLanguage Modeling | CodeCode Available | 0 |
| RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining | Apr 8, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 |