| Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching | Nov 16, 2021 | Contrastive LearningKnowledge Distillation | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Nov 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | —Unverified | 0 |
| Combining static and contextualised multilingual embeddings | Nov 16, 2021 | RetrievalXLM-R | —Unverified | 0 |
| Gradient Sparsification For Masked Fine-Tuning of Transformers | Nov 16, 2021 | Transfer LearningXLM-R | —Unverified | 0 |
| NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection | Nov 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Saliency-based Multi-View Mixed Language Training for Zero-shot Cross-lingual Classification | Nov 1, 2021 | Cross-Lingual Sentiment ClassificationDialogue State Tracking | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Oct 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | CodeCode Available | 0 |
| TEET! Tunisian Dataset for Toxic Speech Detection | Oct 11, 2021 | Feature EngineeringXLM-R | —Unverified | 0 |
| Boosting Transformers for Job Expression Extraction and Classification in a Low-Resource Setting | Sep 17, 2021 | Transfer LearningXLM-R | —Unverified | 0 |
| On the Universality of Deep Contextual Language Models | Sep 15, 2021 | Cross-Lingual TransferXLM-R | —Unverified | 0 |
| FBERT: A Neural Transformer for Identifying Offensive Content | Sep 10, 2021 | Language IdentificationXLM-R | —Unverified | 0 |
| Nearest Neighbour Few-Shot Learning for Cross-lingual Classification | Sep 6, 2021 | ClassificationFew-Shot Learning | CodeCode Available | 0 |
| Siamese Networks for Inference in Malayalam Language Texts | Sep 1, 2021 | Binary ClassificationClassification | —Unverified | 0 |
| Classification of Code-Mixed Text Using Capsule Networks | Sep 1, 2021 | ClassificationXLM-R | —Unverified | 0 |
| Cross-Lingual Text Classification of Transliterated Hindi and Malayalam | Aug 31, 2021 | BenchmarkingClassification | CodeCode Available | 0 |
| Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks | Aug 18, 2021 | XLM-R | —Unverified | 0 |
| LIORI at SemEval-2021 Task 2: Span Prediction and Binary Classification approaches to Word-in-Context Disambiguation | Aug 1, 2021 | Binary ClassificationData Augmentation | —Unverified | 0 |
| COSY: COunterfactual SYntax for Cross-Lingual Understanding | Aug 1, 2021 | counterfactualNatural Language Inference | CodeCode Available | 0 |
| Applying Occam’s Razor to Transformer-Based Dependency Parsing: What Works, What Doesn’t, and What is Really Necessary | Aug 1, 2021 | Dependency ParsingWord Embeddings | —Unverified | 0 |
| ARBERT \& MARBERT: Deep Bidirectional Transformers for Arabic | Aug 1, 2021 | DiversityXLM-R | CodeCode Available | 0 |
| IBM MNLP IE at CASE 2021 Task 1: Multigranular and Multilingual Event Detection on Protest News | Aug 1, 2021 | Event DetectionLanguage Modeling | —Unverified | 0 |
| GlossReader at SemEval-2021 Task 2: Reading Definitions Improves Contextualized Word Embeddings | Aug 1, 2021 | Cross-Lingual TransferLanguage Modelling | —Unverified | 0 |
| RobertNLP at the IWPT 2021 Shared Task: Simple Enhanced UD Parsing for 17 Languages | Aug 1, 2021 | Dependency ParsingXLM-R | —Unverified | 0 |
| SkoltechNLP at SemEval-2021 Task 2: Generating Cross-Lingual Training Data for the Word-in-Context Task | Aug 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Team “DaDeFrNi” at CASE 2021 Task 1: Document and Sentence Classification for Protest Event Detection | Aug 1, 2021 | ArticlesBinary Classification | —Unverified | 0 |