SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 1978 papers

TitleStatusHype
Causality-aware Concept Extraction based on Knowledge-guided PromptingCode1
ChatLog: Carefully Evaluating the Evolution of ChatGPT Across TimeCode1
LaMP: When Large Language Models Meet PersonalizationCode1
Exploring the State of the Art in Legal QA SystemsCode1
Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4Code1
Form-NLU: Dataset for the Form Natural Language UnderstandingCode1
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language ModelsCode1
SwissBERT: The Multilingual Language Model for SwitzerlandCode1
Is BERT Blind? Exploring the Effect of Vision-and-Language Pretraining on Visual Language UnderstandingCode1
Capabilities of GPT-4 on Medical Challenge ProblemsCode1
CTRAN: CNN-Transformer-based Network for Natural Language UnderstandingCode1
Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM FamilyCode1
A Hybrid Architecture for Out of Domain Intent Detection and Intent DiscoveryCode1
MathPrompter: Mathematical Reasoning using Large Language ModelsCode1
A Persian Benchmark for Joint Intent Detection and Slot FillingCode1
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology ImagesCode1
GLADIS: A General and Large Acronym Disambiguation BenchmarkCode1
Call for Papers -- The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpusCode1
ViDeBERTa: A powerful pre-trained language model for VietnameseCode1
Large Language Models as Corporate LobbyistsCode1
Large Language Models Encode Clinical KnowledgeCode1
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in EnglishCode1
Convolution-enhanced Evolving Attention NetworksCode1
Efficient Long Sequence Modeling via State Space Augmented TransformerCode1
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and LanguageCode1
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesCode1
GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization PerspectiveCode1
ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control CommunicationsCode1
CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about NegationCode1
Parameter-Efficient Tuning Makes a Good Classification HeadCode1
Analyzing Multi-Task Learning for Abstractive Text SummarizationCode1
Inducer-tuning: Connecting Prefix-tuning and Adapter-tuningCode1
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language ModelsCode1
InforMask: Unsupervised Informative Masking for Language Model PretrainingCode1
Knowledge Prompting in Pre-trained Language Model for Natural Language UnderstandingCode1
A Win-win Deal: Towards Sparse and Robust Pre-trained Language ModelsCode1
Explaining Patterns in Data with Language Models via Interpretable AutopromptingCode1
ConFiguRe: Exploring Discourse-level Chinese Figures of SpeechCode1
Belief Revision based Caption Re-ranker with Visual Semantic InformationCode1
From Black Boxes to Conversations: Incorporating XAI in a Conversational AgentCode1
FOLIO: Natural Language Reasoning with First-Order LogicCode1
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagesCode1
Efficient Long-Text Understanding with Short-Text ModelsCode1
PLM-ICD: Automatic ICD Coding with Pretrained Language ModelsCode1
Endowing Language Models with Multimodal Knowledge Graph RepresentationsCode1
PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight ImportanceCode1
TCE at Qur'an QA 2022: Arabic Language Question Answering Over Holy Qur'an Using a Post-Processed Ensemble of BERT-based ModelsCode1
TCE at Qur’an QA 2022: Arabic Language Question Answering Over Holy Qur’an Using a Post-Processed Ensemble of BERT-based ModelsCode1
GisPy: A Tool for Measuring Gist Inference Score in TextCode1
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction TuningCode1
Show:102550
← PrevPage 4 of 40Next →
All datasetsPDP60STREUSLELexGLUEDialoGLUE fewshotDialoGLUE fullGLUE

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90—Unverified
2UDSSM-II (ensemble)Accuracy78.3—Unverified
3BERT-large 340MAccuracy78.3—Unverified
4UDSSM-I (ensemble)Accuracy76.7—Unverified
5DSSMAccuracy75—Unverified
6UDSSM-IIAccuracy75—Unverified
7BERT-base 110M + MASAccuracy68.3—Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7—Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60—Unverified
10Subword-level Transformer LMAccuracy58.3—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5—Unverified
2BERT (none)Tags (Full) Acc82—Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81—Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3—Unverified
5RoBERTa + LinearFull F1 (Preps)78.2—Unverified
6GloVe (none)Tags (Full) Acc77.5—Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1—Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2—Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2—Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6—Unverified
2Legal-BERTCaseHOLD75.1—Unverified
3DeBERTaCaseHOLD72.1—Unverified
4LongformerCaseHOLD72—Unverified
5RoBERTaCaseHOLD71.7—Unverified
6BERTCaseHOLD70.7—Unverified
7BigBirdCaseHOLD70.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6—Unverified
2ConvBERT-DG + Pre + MultiAverage73.8—Unverified
3mslmAverage73.49—Unverified
4ConvBERT + Pre + MultiAverage68.22—Unverified
5BanLanGenAverage39.16—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89—Unverified
2mslmAverage85.83—Unverified
3ConvBERT-DG + Pre + MultiAverage85.34—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9—Unverified
2BERT-LARGEAverage82.1—Unverified