SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 501525 of 1978 papers

TitleStatusHype
Creation Of A ChatBot Based On Natural Language Proccesing For Whatsapp0
The Limits of ChatGPT in Extracting Aspect-Category-Opinion-Sentiment Quadruples: A Comparative Analysis0
Dobby: A Conversational Service Robot Driven by GPT-40
GPT-4 as an Agronomist Assistant? Answering Agriculture Exams Using Large Language Models0
LLM for SoC Security: A Paradigm Shift0
SC-Safety: A Multi-round Open-ended Question Adversarial Safety Benchmark for Large Language Models in Chinese0
RAC-BERT: Character Radical Enhanced BERT for Ancient ChineseCode0
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language ModelsCode1
Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language0
SEA: Sparse Linear Attention with Estimated Attention MaskCode1
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering0
ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarios0
Explainable and Accurate Natural Language Understanding for Voice Assistants and Beyond0
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial0
Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal AnalysisCode0
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsCode2
AceGPT, Localizing Large Language Models in ArabicCode1
Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metrics0
Sequence-to-Sequence Spanish Pre-trained Language ModelsCode0
Natural Language Embedded Programs for Hybrid Language Symbolic ReasoningCode1
A Family of Pretrained Transformer Language Models for Russian0
LLM4Jobs: Unsupervised occupation extraction and standardization leveraging Large Language ModelsCode1
Proposition from the Perspective of Chinese Language: A Chinese Proposition Classification Evaluation Benchmark0
Mitigating Shortcuts in Language Models with Soft Label Encoding0
Complex-Valued Neural Networks for Data-Driven Signal Processing and Signal Understanding0
Show:102550
← PrevPage 21 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified