SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 12011250 of 1978 papers

TitleStatusHype
Comparing Test Sets with Item Response Theory0
NewsEmbed: Modeling News through Pre-trained Document Representations0
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better GeneralizationCode0
Defending Pre-trained Language Models from Adversarial Word Substitutions Without Performance SacrificeCode0
Inspecting the concept knowledge graph encoded by modern language models0
Improved OOD Generalization via Adversarial Training and Pre-training0
Introducing the Talk Markup Language (TalkML):Adding a little social intelligence to industrial speech interfaces0
Language Understanding for Field and Service Robots in a Priori Unknown Environments0
KLUE: Korean Language Understanding EvaluationCode1
Towards Target-dependent Sentiment Classification in News ArticlesCode0
Is Knowledge Embedding Fully Exploited in Language Understanding? An Empirical Study0
Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers0
Evaluating Gender Bias in Natural Language InferenceCode0
A Graph Neural Network Approach for Product Relationship Prediction0
News Headline Grouping as a Challenging NLU TaskCode1
Speech2Slot: An End-to-End Knowledge-based Slot Filling from Speech0
XeroAlign: Zero-Shot Cross-lingual Transformer AlignmentCode0
Towards General Natural Language Understanding with Probabilistic WorldbuildingCode1
Translation Quality Assessment: A Brief Survey on Manual and Automatic MethodsCode0
Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks0
RECKONition: a NLP-based system for Industrial Accidents at Work PreventionCode0
Multi-class Text Classification using BERT-based Active Learning0
Semi-supervised Interactive Intent Labeling0
PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel ComputationCode1
BERT-CoQAC: BERT-based Conversational Question Answering in Context0
Adapting Long Context NLM for ASR Rescoring in Conversational Agents0
Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning0
Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables0
X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question AnsweringCode1
Extracting Temporal Event Relation with Syntax-guided Graph TransformerCode0
Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems0
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource LanguagesCode0
Intent Features for Rich Natural Language UnderstandingCode0
SciCo: Hierarchical Cross-Document Coreference for Scientific ConceptsCode1
A recipe for annotating grounded clarifications0
Sequential Cross-Document Coreference Resolution0
On the Importance of Effectively Adapting Pretrained Language Models for Active LearningCode1
A Comparative Study on Collecting High-Quality Implicit Reasonings at a Large-scale0
Effect of Visual Extensions on Natural Language Understanding in Vision-and-Language ModelsCode0
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language ModelsCode1
Empowering News Recommendation with Pre-trained Language ModelsCode1
Natural Language Understanding with Privacy-Preserving BERT0
XTREME-R: Towards More Challenging and Nuanced Multilingual EvaluationCode1
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-CommerceCode1
Zero-Resource Multi-Dialectal Arabic Natural Language Understanding0
Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders0
Targeted Adversarial Training for Natural Language Understanding0
Few-shot Intent Classification and Slot Filling with Retrieved Examples0
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization ApproachCode1
Not All Attention Is All You Need0
Show:102550
← PrevPage 25 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified