| Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress | Nov 25, 2021 | DecoderLanguage Modeling | —Unverified | 0 |
| Generating More Pertinent Captions by Leveraging Semantics and Style on Multi-Source Datasets | Nov 24, 2021 | DescriptiveImage Captioning | —Unverified | 0 |
| Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes | Nov 23, 2021 | Activity RecognitionHuman Activity Recognition | CodeCode Available | 0 |
| UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling | Nov 23, 2021 | Image CaptioningImage Description | CodeCode Available | 1 |
| Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples | Nov 22, 2021 | Knowledge GraphsLanguage Modeling | CodeCode Available | 1 |
| UFO: A UniFied TransfOrmer for Vision-Language Representation Learning | Nov 19, 2021 | Image CaptioningImage-text matching | —Unverified | 0 |
| Linking-Enhanced Pre-Training for Table Semantic Parsing | Nov 18, 2021 | Inductive BiasLanguage Modeling | —Unverified | 0 |
| RoBERTuito: a pre-trained language model for social media text in Spanish | Nov 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing | Nov 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model | Nov 18, 2021 | Anomaly DetectionLanguage Modeling | —Unverified | 0 |
| ClipCap: CLIP Prefix for Image Captioning | Nov 18, 2021 | Image CaptioningLanguage Modeling | CodeCode Available | 2 |
| Green CWS: Extreme Distillation and Efficient Decode Method Towards Industrial Application | Nov 17, 2021 | Chinese Word SegmentationLanguage Modeling | —Unverified | 0 |
| An Exploration of Prompt-Based Zero-Shot Relation Extraction Method | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Generated Knowledge Prompting for Commonsense Reasoning | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Context-Aware Language Modeling for Goal-Oriented Dialogue Systems | Nov 16, 2021 | Data AugmentationGoal-Oriented Dialogue Systems | —Unverified | 0 |
| Contextual Representation Learning beyond Masked Language Modeling | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| End-to-end Task-oriented Dialog Policy Learning based on Pre-trained Language Model | Nov 16, 2021 | dialog state trackingDomain Adaptation | —Unverified | 0 |
| Generative Prompt Tuning for Relation Classification | Nov 16, 2021 | ClassificationLanguage Modeling | —Unverified | 0 |
| End-to-end Reference-free Single-document Summary Quality Assessment | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Improving Unsupervised Sentence Simplification Using Fine-Tuned Masked Language Models | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation | Nov 16, 2021 | Image CaptioningKnowledge Distillation | —Unverified | 0 |
| How does the pre-training objective affect what large language models learn about linguistic properties? | Nov 16, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Contrastive Learning for Low Resource Machine Translation | Nov 16, 2021 | Contrastive LearningData Augmentation | —Unverified | 0 |
| DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog | Nov 16, 2021 | dialog state trackingLanguage Modeling | —Unverified | 0 |