| Punctuation Restoration Improves Structure Understanding Without Supervision | Feb 13, 2024 | ChunkingLanguage Modeling | CodeCode Available | 0 |
| Geographic Adaptation of Pretrained Language Models | Mar 16, 2022 | Language IdentificationLanguage Modeling | CodeCode Available | 0 |
| QueerBench: Quantifying Discrimination in Language Models Toward Queer Identities | Jun 18, 2024 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models | Aug 15, 2023 | DecoderIn-Context Learning | CodeCode Available | 0 |
| Generating Synthetic Free-text Medical Records with Low Re-identification Risk using Masked Language Modeling | Sep 15, 2024 | Causal Language ModelingDe-identification | CodeCode Available | 0 |
| ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction | Apr 4, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining | Oct 25, 2023 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection | Oct 3, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| GeneMask: Fast Pretraining of Gene Sequences to Enable Few-Shot Learning | Jul 29, 2023 | Few-Shot LearningLanguage Modeling | CodeCode Available | 0 |
| From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding | May 15, 2021 | intent-classificationIntent Classification | CodeCode Available | 0 |
| Contextual Grounding of Natural Language Entities in Images | Nov 5, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Fingerprinting web servers through Transformer-encoded HTTP response headers | Mar 26, 2024 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Fine-Grained Emotion Prediction by Modeling Emotion Definitions | Jul 26, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Federated Learning of Medical Concepts Embedding using BEHRT | May 22, 2023 | Federated LearningLanguage Modeling | CodeCode Available | 0 |
| CodeEditor: Learning to Edit Source Code with Pre-trained Models | Oct 31, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| S2SNet: A Pretrained Neural Network for Superconductivity Discovery | Jun 28, 2023 | Electrical EngineeringLanguage Modeling | CodeCode Available | 0 |
| SAS: Self-Augmentation Strategy for Language Model Pre-training | Jun 14, 2021 | Data AugmentationLanguage Modeling | CodeCode Available | 0 |
| SciPrompt: Knowledge-augmented Prompting for Fine-grained Categorization of Scientific Topics | Oct 2, 2024 | ClassificationLanguage Modeling | CodeCode Available | 0 |
| A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer | Apr 27, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Fair multilingual vandalism detection system for Wikipedia | Jun 2, 2023 | Feature EngineeringLanguage Modeling | CodeCode Available | 0 |
| Exploring Unsupervised Pretraining Objectives for Machine Translation | Jun 10, 2021 | DecoderLanguage Modeling | CodeCode Available | 0 |
| Arabic Synonym BERT-based Adversarial Examples for Text Classification | Feb 5, 2024 | Adversarial TextLanguage Modeling | CodeCode Available | 0 |
| Self-Distillation Improves DNA Sequence Inference | May 14, 2024 | Contrastive LearningLanguage Modeling | CodeCode Available | 0 |
| Self-Evolution Learning for Discriminative Language Model Pretraining | May 24, 2023 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| Selfie: Self-supervised Pretraining for Image Embedding | Jun 7, 2019 | Language ModelingLanguage Modelling | CodeCode Available | 0 |