SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 226250 of 1978 papers

TitleStatusHype
Automatic Disfluency Detection from Untranscribed SpeechCode1
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language ModelsCode1
Chess as a Testbed for Language Model State TrackingCode1
Learning to Split for Automatic Bias DetectionCode1
BioBART: Pretraining and Evaluation of A Biomedical Generative Language ModelCode1
A Hybrid Architecture for Out of Domain Intent Detection and Intent DiscoveryCode1
Advances of Transformer-Based Models for News Headline GenerationCode1
BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual PolynomialsCode1
EPIE Dataset: A Corpus For Possible Idiomatic ExpressionsCode1
BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamsCode1
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language ModelsCode1
Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM CompressionCode1
A Win-win Deal: Towards Sparse and Robust Pre-trained Language ModelsCode1
ARBML: Democritizing Arabic Natural Language Processing ToolsCode1
Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact ModelsCode1
Beyond Autoregression: Fast LLMs via Self-Distillation Through TimeCode1
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio GenerationCode1
EPIC30M: An Epidemics Corpus Of Over 30 Million Relevant TweetsCode1
Evaluating Scoped Meaning RepresentationsCode1
From Black Boxes to Conversations: Incorporating XAI in a Conversational AgentCode1
MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument AnnotationCode1
Endowing Language Models with Multimodal Knowledge Graph RepresentationsCode1
A Comprehensive Survey on Graph Neural NetworksCode1
DroidCall: A Dataset for LLM-powered Android Intent InvocationCode1
Towards General Natural Language Understanding with Probabilistic WorldbuildingCode1
Show:102550
← PrevPage 10 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified