SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 12511300 of 1978 papers

TitleStatusHype
What Will it Take to Fix Benchmarking in Natural Language Understanding?0
Intent Detection and Slot Filling for VietnameseCode1
Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA0
Discrete Reasoning Templates for Natural Language Understanding0
Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding0
Intent Recognition and Unsupervised Slot Identification for Low Resourced Spoken Dialog Systems0
Multi-task Learning Using a Combination of Contextualised and Static Word Embeddings for Arabic Sarcasm Detection and Sentiment Analysis0
How Certain is Your Transformer?Code1
Is the Understanding of Explicit Discourse Relations Required in Machine Reading Comprehension?Code0
Is Supervised Syntactic Parsing Beneficial for Language Understanding Tasks? An Empirical Investigation0
Low-Resource Language Modelling of South African LanguagesCode0
Collaborative construction of lexicographic and parallel datasets for African languages: first assessment0
Entity Context Graph: Learning Entity Representations fromSemi-Structured Textual Sources on the Web0
Industry Scale Semi-Supervised Learning for Natural Language Understanding0
Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependencies0
Are Multilingual Models Effective in Code-Switching?0
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures0
Contextual Biasing of Language Models for Speech Recognition in Goal-Oriented Conversational Agents0
Structure Inducing Pre-TrainingCode1
GLM: General Language Model Pretraining with Autoregressive Blank InfillingCode3
GPT Understands, TooCode2
Robustly Optimized and Distilled Training for Natural Language Understanding0
Reweighting Augmented Samples by Minimizing the Maximal Expected LossCode0
Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot FillingCode1
LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation0
Meta-Learning with MAML on Trees0
Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little DataCode1
Syntax-BERT: Improving Pre-trained Transformers with Syntax TreesCode1
Overcoming Poor Word Embeddings with Word Definitions0
Neural model robustness for skill routing in large-scale conversational AI systems: A design choice exploration0
Natural Language Understanding for Argumentative Dialogue Systems in the Opinion Building Domain0
A Linguistic Study on Relevance Modeling in Information Retrieval0
N-Shot Learning for Augmenting Task-Oriented Dialogue State Tracking0
Learning Transferable Visual Models From Natural Language SupervisionCode2
Evaluate On-the-job Learning Dialogue Systems and a Case Study for Natural Language Understanding0
Chess as a Testbed for Language Model State TrackingCode1
From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection0
MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture0
Joint Intent Detection And Slot Filling Based on Continual Learning Model0
A Relational Tsetlin Machine with Applications to Natural Language Understanding0
UniT: Multimodal Multitask Learning with a Unified TransformerCode0
Evolving Attention with Residual ConvolutionsCode1
Have Attention Heads in BERT Learned Constituency Grammar?0
Do as I mean, not as I say: Sequence Loss Training for Spoken Language Understanding0
Speech-language Pre-training for End-to-end Spoken Language Understanding0
A Metamodel and Framework for Artificial General Intelligence From Theory to Practice0
Training Vision Transformers for Image RetrievalCode1
Statistically Profiling Biases in Natural Language Reasoning Datasets and Models0
A Hybrid Task-Oriented Dialog System with Domain and Task Adaptive Pretraining0
The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point0
Show:102550
← PrevPage 26 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified