| AcTune: Uncertainty-aware Active Self-Training for Semi-Supervised Active Learning with Pretrained Language Models | Dec 16, 2021 | Active LearningLanguage Modeling | CodeCode Available | 1 |
| DOCmT5: Document-Level Pretraining of Multilingual Language Models | Dec 16, 2021 | de-enDocument Summarization | —Unverified | 0 |
| Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge | Dec 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Lacuna Reconstruction: Self-supervised Pre-training for Low-Resource Historical Document Transcription | Dec 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Learning To Retrieve Prompts for In-Context Learning | Dec 16, 2021 | In-Context LearningLanguage Modeling | CodeCode Available | 1 |
| Prompt Tuning GPT-2 language model for parameter-efficient domain adaptation of ASR systems | Dec 16, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning | Dec 16, 2021 | Deep Reinforcement LearningGraph Attention | —Unverified | 0 |
| UNIREX: A Unified Learning Framework for Language Model Rationale Extraction | Dec 16, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation | Dec 15, 2021 | Dialogue GenerationLanguage Modeling | —Unverified | 0 |
| Assisted Text Annotation Using Active Learning to Achieve High Quality with Little Effort | Dec 15, 2021 | Active LearningArticles | —Unverified | 0 |
| Applying SoftTriple Loss for Supervised Language Model Fine Tuning | Dec 15, 2021 | General KnowledgeLanguage Modeling | —Unverified | 0 |
| Improving Conversational Recommendation Systems' Quality with Context-Aware Item Meta Information | Dec 15, 2021 | Conversational RecommendationLanguage Modeling | CodeCode Available | 1 |
| Simple Text Detoxification by Identifying a Linear Toxic Subspace in Language Model Embeddings | Dec 15, 2021 | Abusive LanguageLanguage Modeling | —Unverified | 0 |
| Value Retrieval with Arbitrary Queries for Form-like Documents | Dec 15, 2021 | document understandingForm | CodeCode Available | 1 |
| Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling | Dec 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Towards Interactive Language Modeling | Dec 14, 2021 | Language AcquisitionLanguage Modeling | —Unverified | 0 |
| Deciphering antibody affinity maturation with language models and weakly supervised learning | Dec 14, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Few-shot Multi-hop Question Answering over Knowledge Base | Dec 14, 2021 | Few-Shot LearningKnowledge Base Question Answering | —Unverified | 0 |
| Improving Hybrid CTC/Attention End-to-end Speech Recognition with Pretrained Acoustic and Language Model | Dec 14, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework | Dec 14, 2021 | Active LearningLanguage Modeling | —Unverified | 0 |
| CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising | Dec 14, 2021 | Cross-Modal RetrievalDecoder | —Unverified | 0 |
| From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression | Dec 14, 2021 | Contrastive LearningLanguage Modeling | CodeCode Available | 0 |
| Large Language Models are not Models of Natural Language: they are Corpus Models | Dec 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Controlled Cue Generation for Play Scripts | Dec 13, 2021 | AttributeLanguage Modeling | —Unverified | 0 |
| GLaM: Efficient Scaling of Language Models with Mixture-of-Experts | Dec 13, 2021 | Common Sense ReasoningIn-Context Learning | —Unverified | 0 |
| Surfer100: Generating Surveys From Web Resources, Wikipedia-style | Dec 13, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Step-unrolled Denoising Autoencoders for Text Generation | Dec 13, 2021 | DenoisingLanguage Modeling | CodeCode Available | 1 |
| Efficient and Reliable Overlay Networks for Decentralized Federated Learning | Dec 12, 2021 | Federated LearningGeneralization Bounds | —Unverified | 0 |
| Improving Code-switching Language Modeling with Artificially Generated Texts using Cycle-consistent Adversarial Networks | Dec 12, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Discourse-Aware Soft Prompting for Text Generation | Dec 10, 2021 | BlockingConditional Text Generation | —Unverified | 0 |
| Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation | Dec 10, 2021 | Image-text matchingImage-text Retrieval | —Unverified | 0 |
| MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuning | Dec 9, 2021 | In-Context LearningLanguage Modeling | CodeCode Available | 1 |
| From Scattered Sources to Comprehensive Technology Landscape: A Recommendation-based Retrieval Approach | Dec 9, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Scaling Language Models: Methods, Analysis & Insights from Training Gopher | Dec 8, 2021 | Abstract AlgebraAnachronisms | CodeCode Available | 2 |
| Transformer-Based Approach for Joint Handwriting and Named Entity Recognition in Historical documents | Dec 8, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| MLP Architectures for Vision-and-Language Modeling: An Empirical Study | Dec 8, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Zero-Shot Recommendation as Language Modeling | Dec 8, 2021 | Collaborative FilteringLanguage Modeling | CodeCode Available | 1 |
| JABER and SABER: Junior and Senior Arabic BERt | Dec 8, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A deep language model to predict metabolic network equilibria | Dec 7, 2021 | Deep LearningLanguage Modeling | —Unverified | 0 |
| GKS: Graph-based Knowledge Selector for Task-oriented Dialog System | Dec 7, 2021 | Decision MakingGraph Attention | —Unverified | 0 |
| Automated Story Generation as Question-Answering | Dec 7, 2021 | Generative Question AnsweringLanguage Modeling | —Unverified | 0 |
| Quantifying Adaptability in Pre-trained Language Models with 500 Tasks | Dec 6, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| An Effective GCN-based Hierarchical Multi-label classification for Protein Function Prediction | Dec 6, 2021 | Hierarchical Multi-label ClassificationLanguage Modeling | —Unverified | 0 |
| DIBERT: Dependency Injected Bidirectional Encoder Representations from Transformers | Dec 5, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Gaudí: Conversational Interactions with Deep Representations to Generate Image Collections | Dec 5, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning | Dec 5, 2021 | Continual LearningLanguage Modeling | —Unverified | 0 |
| Causal Distillation for Language Models | Dec 5, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Representation Learning for Conversational Data using Discourse Mutual Information Maximization | Dec 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Single-Shot Black-Box Adversarial Attacks Against Malware Detectors: A Causal Language Model Approach | Dec 3, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Siamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Dataset | Dec 3, 2021 | Document RankingLanguage Modeling | CodeCode Available | 1 |