SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 17011725 of 1978 papers

TitleStatusHype
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding DatasetsCode0
WikiCREM: A Large Unsupervised Corpus for Coreference ResolutionCode0
Encoder-Agnostic Adaptation for Conditional Language GenerationCode0
A Multi-level Neural Network for Implicit Causality Detection in Web TextsCode0
Learning Conceptual-Contextual Embeddings for Medical Text0
CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from TextCode1
SenseBERT: Driving Some Sense into BERT0
Scalable Attentive Sentence-Pair Modeling via Distilled Sentence EmbeddingCode0
Reasoning-Driven Question-Answering for Natural Language Understanding0
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding0
Active Annotation: bootstrapping annotation lexicon and guidelines for supervised NLU learning0
A Weakly-Supervised Attention-based Visualization Tool for Assessing Political Affiliation0
Meaning Representation of Null Instantiated Semantic Roles in FrameNet0
Towards Universal Semantic Representation0
Augmenting Named Entity Recognition with Commonsense Knowledge0
Leveraging Pre-trained Checkpoints for Sequence Generation TasksCode1
A Hybrid Neural Network Model for Commonsense Reasoning0
Using Answer Set Programming for Commonsense Reasoning in the Winograd Schema Challenge0
Structured Knowledge Discovery from Massive Text Corpus0
Why Build an Assistant in Minecraft?Code0
A Pragmatics-Centered Evaluation Framework for Natural Language UnderstandingCode0
Task Selection Policies for Multitask Learning0
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
Solving Hard Coreference Problems0
Incrementalizing RASA's Open-Source Natural Language Understanding Pipeline0
Show:102550
← PrevPage 69 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified