SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 19011925 of 1978 papers

TitleStatusHype
CoNFET: An English Sentence to Emojis Translation AlgorithmCode0
Auto-SLURP: A Benchmark Dataset for Evaluating Multi-Agent Frameworks in Smart Personal AssistantCode0
Concept Tagging for Natural Language Understanding: Two Decadelong Algorithm DevelopmentCode0
Natural Language Processing for Information ExtractionCode0
Automatic Pruning of Fine-tuning Datasets for Transformer-based Language ModelsCode0
Seeing Things from a Different Angle:Discovering Diverse Perspectives about ClaimsCode0
Natural language understanding for logical gamesCode0
Seeing Things from a Different Angle: Discovering Diverse Perspectives about ClaimsCode0
Natural Language Understanding with Distributed RepresentationCode0
A Unified Framework for Slot based Response Generation in a Multimodal Dialogue SystemCode0
XeroAlign: Zero-Shot Cross-lingual Transformer AlignmentCode0
Comprehensive Supersense Disambiguation of English Prepositions and PossessivesCode0
NEO-BENCH: Evaluating Robustness of Large Language Models with NeologismsCode0
NER4ID at SemEval-2022 Task 2: Named Entity Recognition for Idiomaticity DetectionCode0
AudioFormer: Audio Transformer learns audio feature representations from discrete acoustic codesCode0
A Language for Function Signature RepresentationsCode0
Neural Architecture Search: Insights from 1000 PapersCode0
Neural Architecture Search with Reinforcement LearningCode0
Translation Quality Assessment: A Brief Survey on Manual and Automatic MethodsCode0
Attention-Informed Mixed-Language Training for Zero-shot Cross-lingual Task-oriented Dialogue SystemsCode0
Neural Models for Sequence ChunkingCode0
Complement Objective TrainingCode0
Empirical Analysis of Foundational Distinctions in Linked Open DataCode0
Neural Semantic EncodersCode0
Text Summarization using Abstract Meaning RepresentationCode0
Show:102550
← PrevPage 77 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified