SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 351375 of 1978 papers

TitleStatusHype
Incorporating BERT into Neural Machine TranslationCode1
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagesCode1
PIQA: Reasoning about Physical Commonsense in Natural LanguageCode1
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight ImportanceCode1
Enhancing Language Representation with Constructional Information for Natural Language UnderstandingCode1
Benchmarking Natural Language Understanding Services for building Conversational AgentsCode1
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language ModelsCode1
Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language UnderstandingCode1
Improving Language Understanding by Generative Pre-TrainingCode1
Adapting Pretrained Transformer to Lattices for Spoken Language UnderstandingCode1
Entailment as Robust Self-LearnerCode1
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language UnderstandingCode1
Belief Revision based Caption Re-ranker with Visual Semantic InformationCode1
EPIE Dataset: A Corpus For Possible Idiomatic ExpressionsCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
CLUES: Few-Shot Learning Evaluation in Natural Language UnderstandingCode1
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction TuningCode1
Event Time Extraction and Propagation via Graph Attention NetworksCode1
Relative Importance in Sentence ProcessingCode1
Resource-Efficient Transformer Pruning for Finetuning of Large ModelsCode1
RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz Dataset with Rich Semantic Annotations for Task-Oriented Dialogue ModelingCode1
Evaluating Scoped Meaning RepresentationsCode1
Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4Code1
Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM FamilyCode1
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesCode1
Show:102550
← PrevPage 15 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified