SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 14761500 of 1978 papers

TitleStatusHype
How To Evaluate Your Dialogue System: Probe Tasks as an Alternative for Token-level Evaluation MetricsCode0
VisualSem: A High-quality Knowledge Graph for Vision and LanguageCode1
Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical InvestigationCode0
Speech To Semantics: Improve ASR and NLU Jointly via All-Neural Interfaces0
Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems0
Privacy Guarantees for De-identifying Text TransformationsCode0
ConvBERT: Improving BERT with Span-based Dynamic ConvolutionCode1
KBot: a Knowledge graph based chatBot for natural language understanding over linked data0
Self-supervised Learning for Large-scale Item Recommendations0
From Spatial Relations to Spatial Configurations0
Mono vs Multilingual Transformer-based Models: a Comparison across Several Language TasksCode0
Towards an Automated SOAP Note: Classifying Utterances from Medical Conversations0
Towards Debiasing Sentence RepresentationsCode1
LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical ReasoningCode1
Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring SystemsCode1
HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections0
Advances of Transformer-Based Models for News Headline GenerationCode1
Logic, Language, and Calculus0
Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning0
A Semantic Web Framework for Automated Smart Assistants: COVID-19 Case Study0
Can Wikipedia Categories Improve Masked Language Model Pretraining?0
Using Alternate Representations of Text for Natural Language Understanding0
CopyBERT: A Unified Approach to Question Generation with Self-Attention0
Programming in Natural Language with fuSE: Synthesizing Methods from Spoken Utterances Using Deep Natural Language Understanding0
Would you Rather? A New Benchmark for Learning Machine Alignment with Cultural Values and Social Preferences0
Show:102550
← PrevPage 60 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified