| Multitask Finetuning for Improving Neural Machine Translation in Indian Languages | Dec 3, 2021 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| Probing Linguistic Information For Logical Inference In Pre-trained Language Models | Dec 3, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Prompt-free and Efficient Language Model Fine-Tuning | Dec 2, 2021 | Few-Shot LearningLanguage Modeling | —Unverified | 0 |
| InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation | Dec 2, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding | Dec 2, 2021 | Knowledge GraphsKnowledge Probing | —Unverified | 0 |
| An Investigation of Hybrid architectures for Low Resource Multilingual Speech Recognition system in Indian context | Dec 1, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| An End-to-End Speech Recognition for the Nepali Language | Dec 1, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| MacBERTh: Development and Evaluation of a Historically Pre-trained Language Model for English (1450-1950) | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Cross-Domain Language Modeling: An Empirical Investigation | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Building astroBERT, a language model for Astronomy & Astrophysics | Dec 1, 2021 | AstronomyLanguage Modeling | —Unverified | 0 |
| Interactive Model with Structural Loss for Language-based Abductive Reasoning | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| DPRK-BERT: The Supreme Language Model | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| NER-BERT: A Pre-trained Model for Low-Resource Entity Tagging | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Searching for Efficient Transformers for Language Modeling | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Multilingual Pre-training with Universal Dependency Learning | Dec 1, 2021 | Dependency ParsingLanguage Modeling | —Unverified | 0 |
| Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models | Nov 30, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Zero-Shot Semantic Segmentation via Spatial and Multi-Scale Aware Visual Class Embedding | Nov 30, 2021 | Domain AdaptationLanguage Modeling | —Unverified | 0 |
| A Simple Long-Tailed Recognition Baseline via Vision-Language Model | Nov 29, 2021 | Contrastive LearningLanguage Modeling | CodeCode Available | 1 |
| Customer Sentiment Analysis using Weak Supervision for Customer-Agent Chat | Nov 29, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| PSG: Prompt-based Sequence Generation for Acronym Extraction | Nov 29, 2021 | document understandingLanguage Modeling | —Unverified | 0 |
| ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic | Nov 29, 2021 | Contrastive LearningDescriptive | CodeCode Available | 1 |
| FastTrees: Parallel Latent Tree-Induction for Faster Sequence Encoding | Nov 28, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Zero-Shot Cross-Lingual Transfer in Legal Domain Using Transformer Models | Nov 28, 2021 | ClassificationCross-Lingual Transfer | CodeCode Available | 0 |
| Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model | Nov 26, 2021 | Image ManipulationLanguage Modeling | CodeCode Available | 1 |
| A multitask transfer learning framework for the prediction of virus-human protein-protein interactions | Nov 26, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress | Nov 25, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Generating More Pertinent Captions by Leveraging Semantics and Style on Multi-Source Datasets | Nov 24, 2021 | DescriptiveImage Captioning | —Unverified | 0 |
| Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes | Nov 23, 2021 | Activity RecognitionHuman Activity Recognition | CodeCode Available | 0 |
| UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling | Nov 23, 2021 | Image CaptioningImage Description | CodeCode Available | 1 |
| Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples | Nov 22, 2021 | Knowledge GraphsLanguage Modeling | CodeCode Available | 1 |
| UFO: A UniFied TransfOrmer for Vision-Language Representation Learning | Nov 19, 2021 | Image CaptioningImage-text matching | —Unverified | 0 |
| Linking-Enhanced Pre-Training for Table Semantic Parsing | Nov 18, 2021 | Inductive BiasLanguage Modeling | —Unverified | 0 |
| RoBERTuito: a pre-trained language model for social media text in Spanish | Nov 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing | Nov 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model | Nov 18, 2021 | Anomaly DetectionLanguage Modeling | —Unverified | 0 |
| ClipCap: CLIP Prefix for Image Captioning | Nov 18, 2021 | Image CaptioningLanguage Modeling | CodeCode Available | 2 |
| Green CWS: Extreme Distillation and Efficient Decode Method Towards Industrial Application | Nov 17, 2021 | Chinese Word SegmentationLanguage Modeling | —Unverified | 0 |
| An Exploration of Prompt-Based Zero-Shot Relation Extraction Method | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Generated Knowledge Prompting for Commonsense Reasoning | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Context-Aware Language Modeling for Goal-Oriented Dialogue Systems | Nov 16, 2021 | Data AugmentationGoal-Oriented Dialogue Systems | —Unverified | 0 |
| Contextual Representation Learning beyond Masked Language Modeling | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| End-to-end Task-oriented Dialog Policy Learning based on Pre-trained Language Model | Nov 16, 2021 | dialog state trackingDomain Adaptation | —Unverified | 0 |
| Generative Prompt Tuning for Relation Classification | Nov 16, 2021 | ClassificationLanguage Modeling | —Unverified | 0 |
| End-to-end Reference-free Single-document Summary Quality Assessment | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Improving Unsupervised Sentence Simplification Using Fine-Tuned Masked Language Models | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation | Nov 16, 2021 | Image CaptioningKnowledge Distillation | —Unverified | 0 |
| How does the pre-training objective affect what large language models learn about linguistic properties? | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Contrastive Learning for Low Resource Machine Translation | Nov 16, 2021 | Contrastive LearningData Augmentation | —Unverified | 0 |
| DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog | Nov 16, 2021 | dialog state trackingLanguage Modeling | —Unverified | 0 |