SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 301350 of 1978 papers

TitleStatusHype
Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language UnderstandingCode0
Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and DesignCode1
Thai Winograd Schemas: A Benchmark for Thai Commonsense ReasoningCode0
RLSF: Reinforcement Learning via Symbolic Feedback0
BOLD: Boolean Logic Deep Learning0
Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt AdaptationCode0
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector BanksCode1
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMsCode0
Leveraging Large Language Models for Semantic Query Processing in a Scholarly Knowledge Graph0
Contrastive and Consistency Learning for Neural Noisy-Channel Model in Spoken Language UnderstandingCode0
SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language ModelsCode2
A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference CorpusCode0
Cross-Language Assessment of Mathematical Capability of ChatGPT0
INDUS: Effective and Efficient Language Models for Scientific Applications0
DEPTH: Discourse Education through Pre-Training HierarchicallyCode0
Translating Expert Intuition into Quantifiable Features: Encode Investigator Domain Knowledge via LLM for Enhanced Predictive Analytics0
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation0
Can large language models understand uncommon meanings of common words?0
D-NLP at SemEval-2024 Task 2: Evaluating Clinical Inference Capabilities of Large Language ModelsCode0
TED: Accelerate Model Training by Internal Generalization0
Quantifying the Capabilities of LLMs across Scale and Precision0
GREEN: Generative Radiology Report Evaluation and Error Notation0
A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU0
Parameter-Efficient Fine-Tuning with Discrete Fourier TransformCode2
Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive StudyCode0
Structural Pruning of Pre-trained Language Models via Neural Architecture SearchCode0
Identification of Entailment and Contradiction Relations between Natural Language Sentences: A Neurosymbolic Approach0
Towards Generalist Robot Learning from Internet Video: A Survey0
An empirical study of LLaMA3 quantization: from LLMs to MLLMsCode2
Towards Logically Consistent Language Models via Probabilistic Reasoning0
Large Language Models for Networking: Workflow, Advances and Challenges0
Skeleton: A New Framework for Accelerating Language Models via Task Neuron Localized Prompt Tuning0
From Form(s) to Meaning: Probing the Semantic Depths of Language Models Using Multisense ConsistencyCode0
Binder: Hierarchical Concept Representation through Order Embedding of Binary Vectors0
Automating REST API Postman Test Cases Using LLM0
ANCHOR: LLM-driven News Subject Conditioning for Text-to-Image SynthesisCode0
TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table DecompositionCode1
MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter ExpertsCode5
On Training Data Influence of GPT ModelsCode1
Data-Augmentation-Based Dialectal Adaptation for LLMsCode0
Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain0
XNLIeu: a dataset for cross-lingual NLI in BasqueCode0
GUIDE: Graphical User Interface Data for Execution0
LLMs' Reading Comprehension Is Affected by Parametric Knowledge and Struggles with Hypothetical Statements0
Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training0
RecGPT: Generative Personalized Prompts for Sequential Recommendation via ChatGPT Training Paradigm0
Conversational Disease Diagnosis via External Planner-Controlled Large Language ModelsCode0
Intent Detection and Entity Extraction from BioMedical LiteratureCode0
Do Large Language Models Rank Fairly? An Empirical Study on the Fairness of LLMs as Rankers0
Jump Self-attention: Capturing High-order Statistics in Transformers0
Show:102550
← PrevPage 7 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified