SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 351400 of 1978 papers

TitleStatusHype
Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT PerspectiveCode1
MEG: Medical Knowledge-Augmented Large Language Models for Question AnsweringCode1
Dual Inference for Improving Language Understanding and GenerationCode1
Anno-MI: A Dataset of Expert-Annotated Counselling DialoguesCode1
Dual Learning for Semi-Supervised Natural Language UnderstandingCode1
CSKG: The CommonSense Knowledge GraphCode1
CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about NegationCode1
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-TuningCode1
Benchmarking Robustness of Machine Reading Comprehension ModelsCode1
DroidCall: A Dataset for LLM-powered Android Intent InvocationCode1
Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot FillingCode1
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language UnderstandingCode1
Neural RST-based Evaluation of Discourse CoherenceCode1
News Headline Grouping as a Challenging NLU TaskCode1
Dual Supervised Learning for Natural Language Understanding and GenerationCode1
CLUES: Few-Shot Learning Evaluation in Natural Language UnderstandingCode1
CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from TextCode1
On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and ReasoningCode1
On Transferability of Prompt Tuning for Natural Language ProcessingCode1
Optimal Subarchitecture Extraction For BERTCode1
Benchmarking Natural Language Understanding Services for building Conversational AgentsCode1
PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel ComputationCode1
Distilling Large Vision-Language Model with Out-of-Distribution GeneralizabilityCode1
ParsiNLU: A Suite of Language Understanding Challenges for PersianCode1
AllenNLP: A Deep Semantic Natural Language Processing PlatformCode1
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight ImportanceCode1
Belief Revision based Caption Re-ranker with Visual Semantic InformationCode1
ConFiguRe: Exploring Discourse-level Chinese Figures of SpeechCode1
DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented DialogueCode1
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language ModelsCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
A Surprisingly Robust Trick for Winograd Schema ChallengeCode1
Instructive Decoding: Instruction-Tuned Large Language Models are Self-Refiner from Noisy InstructionsCode1
DVMNet++: Rethinking Relative Pose Estimation for Unseen ObjectsCode1
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsCode1
Empowering News Recommendation with Pre-trained Language ModelsCode1
Structure Inducing Pre-TrainingCode1
Rethinking Positional Encoding in Language Pre-trainingCode1
RoBERTuito: a pre-trained language model for social media text in SpanishCode1
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical SemanticsCode1
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERTCode1
Joint Localization and Activation Editing for Low-Resource Fine-TuningCode1
Question Answering as Programming for Solving Time-Sensitive QuestionsCode1
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering0
An Interdisciplinary Review of Commonsense Reasoning and Intent Detection0
BaSCo: An Annotated Basque-Spanish Code-Switching Corpus for Natural Language Understanding0
Teaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approach0
Designing the Next Generation of Intelligent Personal Robotic Assistants for the Physically Impaired0
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla0
An Improved Neural Baseline for Temporal Relation Extraction0
Show:102550
← PrevPage 8 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified