SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 751775 of 1978 papers

TitleStatusHype
D-NLP at SemEval-2024 Task 2: Evaluating Clinical Inference Capabilities of Large Language ModelsCode0
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better GeneralizabilityCode0
MaxVA: Fast Adaptation of Step Sizes by Maximizing Observed Variance of GradientsCode0
RAC-BERT: Character Radical Enhanced BERT for Ancient ChineseCode0
Hierarchical Multi-Task Natural Language Understanding for Cross-domain Conversational AI: HERMIT NLUCode0
How Decoding Strategies Affect the Verifiability of Generated TextCode0
A Study on the Calibration of In-context LearningCode0
Beyond 512 Tokens: Siamese Multi-depth Transformer-based Hierarchical Encoder for Long-Form Document MatchingCode0
HICL: Hashtag-Driven In-Context Learning for Social Media Natural Language UnderstandingCode0
HeGeL: A Novel Dataset for Geo-Location from Hebrew TextCode0
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better GeneralizationCode0
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-trainingCode0
How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasetsCode0
DisSent: Sentence Representation Learning from Explicit Discourse RelationsCode0
DisSent: Learning Sentence Representations from Explicit Discourse RelationsCode0
CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic ModelingCode0
A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference CorpusCode0
Grounding learning of modifier dynamics: An application to color namingCode0
A Pragmatics-Centered Evaluation Framework for Natural Language UnderstandingCode0
Discontinuous Grammar as a Foreign LanguageCode0
BERT Knows Punta Cana is not just beautiful, it's gorgeous: Ranking Scalar Adjectives with Contextualised RepresentationsCode0
BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task LearningCode0
GlyphPattern: An Abstract Pattern Recognition for Vision-Language ModelsCode0
Scalable Attentive Sentence-Pair Modeling via Distilled Sentence EmbeddingCode0
Goal-Oriented Script ConstructionCode0
Show:102550
← PrevPage 31 of 80Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified