| Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching | Nov 16, 2021 | Contrastive LearningKnowledge Distillation | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Nov 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | —Unverified | 0 |
| Combining static and contextualised multilingual embeddings | Nov 16, 2021 | RetrievalXLM-R | —Unverified | 0 |
| Gradient Sparsification For Masked Fine-Tuning of Transformers | Nov 16, 2021 | Transfer LearningXLM-R | —Unverified | 0 |
| NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection | Nov 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Saliency-based Multi-View Mixed Language Training for Zero-shot Cross-lingual Classification | Nov 1, 2021 | Cross-Lingual Sentiment ClassificationDialogue State Tracking | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Oct 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | CodeCode Available | 0 |
| TEET! Tunisian Dataset for Toxic Speech Detection | Oct 11, 2021 | Feature EngineeringXLM-R | —Unverified | 0 |
| Boosting Transformers for Job Expression Extraction and Classification in a Low-Resource Setting | Sep 17, 2021 | Transfer LearningXLM-R | —Unverified | 0 |
| On the Universality of Deep Contextual Language Models | Sep 15, 2021 | Cross-Lingual TransferXLM-R | —Unverified | 0 |
| FBERT: A Neural Transformer for Identifying Offensive Content | Sep 10, 2021 | Language IdentificationXLM-R | —Unverified | 0 |
| Nearest Neighbour Few-Shot Learning for Cross-lingual Classification | Sep 6, 2021 | ClassificationFew-Shot Learning | CodeCode Available | 0 |
| Siamese Networks for Inference in Malayalam Language Texts | Sep 1, 2021 | Binary ClassificationClassification | —Unverified | 0 |
| Classification of Code-Mixed Text Using Capsule Networks | Sep 1, 2021 | ClassificationXLM-R | —Unverified | 0 |
| Cross-Lingual Text Classification of Transliterated Hindi and Malayalam | Aug 31, 2021 | BenchmarkingClassification | CodeCode Available | 0 |
| Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks | Aug 18, 2021 | XLM-R | —Unverified | 0 |
| LIORI at SemEval-2021 Task 2: Span Prediction and Binary Classification approaches to Word-in-Context Disambiguation | Aug 1, 2021 | Binary ClassificationData Augmentation | —Unverified | 0 |
| COSY: COunterfactual SYntax for Cross-Lingual Understanding | Aug 1, 2021 | counterfactualNatural Language Inference | CodeCode Available | 0 |
| Applying Occam’s Razor to Transformer-Based Dependency Parsing: What Works, What Doesn’t, and What is Really Necessary | Aug 1, 2021 | Dependency ParsingWord Embeddings | —Unverified | 0 |
| ARBERT \& MARBERT: Deep Bidirectional Transformers for Arabic | Aug 1, 2021 | DiversityXLM-R | CodeCode Available | 0 |
| IBM MNLP IE at CASE 2021 Task 1: Multigranular and Multilingual Event Detection on Protest News | Aug 1, 2021 | Event DetectionLanguage Modeling | —Unverified | 0 |
| GlossReader at SemEval-2021 Task 2: Reading Definitions Improves Contextualized Word Embeddings | Aug 1, 2021 | Cross-Lingual TransferLanguage Modelling | —Unverified | 0 |
| RobertNLP at the IWPT 2021 Shared Task: Simple Enhanced UD Parsing for 17 Languages | Aug 1, 2021 | Dependency ParsingXLM-R | —Unverified | 0 |
| SkoltechNLP at SemEval-2021 Task 2: Generating Cross-Lingual Training Data for the Word-in-Context Task | Aug 1, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Team “DaDeFrNi” at CASE 2021 Task 1: Document and Sentence Classification for Protest Event Detection | Aug 1, 2021 | ArticlesBinary Classification | —Unverified | 0 |
| 利用语义关联增强的跨语言预训练模型的译文质量评估(A Cross-language Pre-trained Model with Enhanced Semantic Connection for MT Quality Estimation) | Aug 1, 2021 | XLM-R | —Unverified | 0 |
| Emotion Stimulus Detection in German News Headlines | Jul 27, 2021 | Emotion RecognitionSentence | —Unverified | 0 |
| TGIF: Tree-Graph Integrated-Format Parser for Enhanced UD with Two-Stage Generic- to Individual-Language Finetuning | Jul 14, 2021 | SentenceSentence segmentation | —Unverified | 0 |
| A Primer on Pretrained Multilingual Language Models | Jul 1, 2021 | Joint Multilingual Sentence RepresentationsMultilingual text classification | —Unverified | 0 |
| Automatic Sexism Detection with Multilingual Transformer Models | Jun 9, 2021 | Binary ClassificationClassification | —Unverified | 0 |
| How to Adapt Your Pretrained Multilingual Model to 1600 Languages | Jun 3, 2021 | Cross-Lingual TransferNER | —Unverified | 0 |
| Diagnosing Transformers in Task-Oriented Semantic Parsing | May 27, 2021 | Semantic Parsingvalid | —Unverified | 0 |
| XeroAlign: Zero-Shot Cross-lingual Transformer Alignment | May 6, 2021 | Multilingual NLPNatural Language Understanding | CodeCode Available | 0 |
| Larger-Scale Transformers for Multilingual Masked Language Modeling | May 2, 2021 | Language ModelingLanguage Modelling | —Unverified | 0 |
| Multilingual and Zero-Shot is Closing in on Monolingual Web Register Classification | May 1, 2021 | ArticlesCross-Lingual Transfer | —Unverified | 0 |
| AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages | Apr 18, 2021 | Cross-Lingual TransferNatural Language Understanding | CodeCode Available | 0 |
| Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training | Apr 17, 2021 | Cross-Lingual TransferSentence | CodeCode Available | 0 |
| Bilingual alignment transfers to multilingual alignment for unsupervised parallel text mining | Apr 15, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers | Apr 4, 2021 | Cross-Lingual TransferSentence | —Unverified | 0 |
| Challenges in Annotating and Parsing Spoken, Code-switched, Frisian-Dutch Data | Apr 1, 2021 | XLM-R | CodeCode Available | 0 |
| Benchmarking Pre-trained Language Models for Multilingual NER: TraSpaS at the BSNLP2021 Shared Task | Apr 1, 2021 | BenchmarkingLanguage Modeling | CodeCode Available | 0 |
| Priberam Labs at the 3rd Shared Task on SlavNER | Apr 1, 2021 | named-entity-recognitionNamed Entity Recognition | —Unverified | 0 |
| LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation | Mar 11, 2021 | Natural Language UnderstandingXLM-R | —Unverified | 0 |
| Automatic Difficulty Classification of Arabic Sentences | Mar 7, 2021 | Binary ClassificationClassification | —Unverified | 0 |
| Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages | Mar 1, 2021 | Depth EstimationDepth Prediction | —Unverified | 0 |
| NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformers | Feb 28, 2021 | Multilingual text classificationXLM-R | CodeCode Available | 0 |
| Bootstrapping Multilingual AMR with Contextual Word Alignments | Feb 3, 2021 | Multilingual Word EmbeddingsWord Alignment | —Unverified | 0 |
| LOME: Large Ontology Multilingual Extraction | Jan 28, 2021 | coreference-resolutionCoreference Resolution | —Unverified | 0 |
| Distilling Large Language Models into Tiny and Effective Students using pQRNN | Jan 21, 2021 | Data AugmentationSemantic Parsing | —Unverified | 0 |
| MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers | Dec 31, 2020 | RelationXLM-R | CodeCode Available | 0 |