| SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Knowledge Perceived Multi-modal Pretraining in E-commerce | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Pre-training for Ad-hoc Retrieval: Hyperlink is Also You Need | Aug 20, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| Modeling Protein Using Large-scale Pretrain Language Model | Aug 17, 2021 | Drug DiscoveryLanguage Modeling | CodeCode Available | 1 |
| Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval | Aug 12, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| DEMix Layers: Disentangling Domains for Modular Language Modeling | Aug 11, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 1 |
| BROS: A Pre-trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents | Aug 10, 2021 | Key Information ExtractionLanguage Modeling | CodeCode Available | 1 |
| Noisy Channel Language Model Prompting for Few-Shot Text Classification | Aug 9, 2021 | AttributeClassification | CodeCode Available | 1 |
| Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification | Aug 5, 2021 | Automatic Speech RecognitionAutomatic Speech Recognition (ASR) | CodeCode Available | 1 |
| Finetuning Pretrained Transformers into Variational Autoencoders | Aug 5, 2021 | DecoderLanguage Modeling | CodeCode Available | 1 |
