| Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation | Dec 10, 2021 | Image-text matchingImage-text Retrieval | —Unverified | 0 |
| From Scattered Sources to Comprehensive Technology Landscape: A Recommendation-based Retrieval Approach | Dec 9, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| JABER and SABER: Junior and Senior Arabic BERt | Dec 8, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Transformer-Based Approach for Joint Handwriting and Named Entity Recognition in Historical documents | Dec 8, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| GKS: Graph-based Knowledge Selector for Task-oriented Dialog System | Dec 7, 2021 | Decision MakingGraph Attention | —Unverified | 0 |
| Automated Story Generation as Question-Answering | Dec 7, 2021 | Generative Question AnsweringLanguage Modeling | —Unverified | 0 |
| A deep language model to predict metabolic network equilibria | Dec 7, 2021 | Deep LearningLanguage Modeling | —Unverified | 0 |
| An Effective GCN-based Hierarchical Multi-label classification for Protein Function Prediction | Dec 6, 2021 | Hierarchical Multi-label ClassificationLanguage Modeling | —Unverified | 0 |
| DIBERT: Dependency Injected Bidirectional Encoder Representations from Transformers | Dec 5, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Gaudí: Conversational Interactions with Deep Representations to Generate Image Collections | Dec 5, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning | Dec 5, 2021 | Continual LearningLanguage Modeling | —Unverified | 0 |
| Representation Learning for Conversational Data using Discourse Mutual Information Maximization | Dec 4, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Probing Linguistic Information For Logical Inference In Pre-trained Language Models | Dec 3, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Multitask Finetuning for Improving Neural Machine Translation in Indian Languages | Dec 3, 2021 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| Single-Shot Black-Box Adversarial Attacks Against Malware Detectors: A Causal Language Model Approach | Dec 3, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Prompt-free and Efficient Language Model Fine-Tuning | Dec 2, 2021 | Few-Shot LearningLanguage Modeling | —Unverified | 0 |
| DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding | Dec 2, 2021 | Knowledge GraphsKnowledge Probing | —Unverified | 0 |
| An End-to-End Speech Recognition for the Nepali Language | Dec 1, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Cross-Domain Language Modeling: An Empirical Investigation | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| An Investigation of Hybrid architectures for Low Resource Multilingual Speech Recognition system in Indian context | Dec 1, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | —Unverified | 0 |
| Building astroBERT, a language model for Astronomy & Astrophysics | Dec 1, 2021 | AstronomyLanguage Modeling | —Unverified | 0 |
| Interactive Model with Structural Loss for Language-based Abductive Reasoning | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| DPRK-BERT: The Supreme Language Model | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| MacBERTh: Development and Evaluation of a Historically Pre-trained Language Model for English (1450-1950) | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Searching for Efficient Transformers for Language Modeling | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Multilingual Pre-training with Universal Dependency Learning | Dec 1, 2021 | Dependency ParsingLanguage Modeling | —Unverified | 0 |
| NER-BERT: A Pre-trained Model for Low-Resource Entity Tagging | Dec 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Zero-Shot Semantic Segmentation via Spatial and Multi-Scale Aware Visual Class Embedding | Nov 30, 2021 | Domain AdaptationLanguage Modeling | —Unverified | 0 |
| PSG: Prompt-based Sequence Generation for Acronym Extraction | Nov 29, 2021 | document understandingLanguage Modeling | —Unverified | 0 |
| Customer Sentiment Analysis using Weak Supervision for Customer-Agent Chat | Nov 29, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| FastTrees: Parallel Latent Tree-Induction for Faster Sequence Encoding | Nov 28, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Zero-Shot Cross-Lingual Transfer in Legal Domain Using Transformer Models | Nov 28, 2021 | ClassificationCross-Lingual Transfer | CodeCode Available | 0 |
| A multitask transfer learning framework for the prediction of virus-human protein-protein interactions | Nov 26, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress | Nov 25, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Generating More Pertinent Captions by Leveraging Semantics and Style on Multi-Source Datasets | Nov 24, 2021 | DescriptiveImage Captioning | —Unverified | 0 |
| Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes | Nov 23, 2021 | Activity RecognitionHuman Activity Recognition | CodeCode Available | 0 |
| UFO: A UniFied TransfOrmer for Vision-Language Representation Learning | Nov 19, 2021 | Image CaptioningImage-text matching | —Unverified | 0 |
| Linking-Enhanced Pre-Training for Table Semantic Parsing | Nov 18, 2021 | Inductive BiasLanguage Modeling | —Unverified | 0 |
| LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model | Nov 18, 2021 | Anomaly DetectionLanguage Modeling | —Unverified | 0 |
| Green CWS: Extreme Distillation and Efficient Decode Method Towards Industrial Application | Nov 17, 2021 | Chinese Word SegmentationLanguage Modeling | —Unverified | 0 |
| Extracting and Inferring Personal Attributes from Dialogue | Nov 16, 2021 | AttributeLanguage Modeling | —Unverified | 0 |
| Can Language Models Be Specific? How? | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Aligned Weight Regularizers for Pruning Pretrained Neural Networks | Nov 16, 2021 | Knowledge DistillationLanguage Modeling | —Unverified | 0 |
| Learning Tokenization in Private Federated Learning with Sub-Word Model Sampling | Nov 16, 2021 | Federated LearningLanguage Modeling | —Unverified | 0 |
| Error-Correcting Codes For Approximate Neural Sequence Prediction | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| IDPG: An Instance-Dependent Prompt Generation Method | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Improving Controllable Text Generation with Position-Aware Weighted Decoding | Nov 16, 2021 | AttributeLanguage Modeling | —Unverified | 0 |
| gaBERT — an Irish Language Model | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification | Nov 16, 2021 | ClassificationEntity Typing | —Unverified | 0 |
| AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |