SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 551600 of 1978 papers

TitleStatusHype
Jailbreaking and Mitigation of Vulnerabilities in Large Language Models0
Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Experiments, and Challenges0
MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations0
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-TuningCode0
SLM-Mod: Small Language Models Surpass LLMs at Content ModerationCode0
VL-GLUE: A Suite of Fundamental yet Challenging Visuo-Linguistic Reasoning TasksCode0
Enhancing Text Generation in Joint NLG/NLU Learning Through Curriculum Learning, Semi-Supervised Training, and Advanced Optimization Techniques0
PromptExp: Multi-granularity Prompt Explanation of Large Language Models0
Expanding Chatbot Knowledge in Customer Service: Context-Aware Similar Question Generation Using Large Language Models0
SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimization0
Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning0
TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretraining0
BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation0
StraGo: Harnessing Strategic Guidance for Prompt Optimization0
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt TuningCode0
KRAG Framework for Enhancing LLMs in the Legal Domain0
An Approach for Auto Generation of Labeling Functions for Software Engineering Chatbots0
FltLM: An Intergrated Long-Context Large Language Model for Effective Context Filtering and Understanding0
SpaLLM: Unified Compressive Adaptation of Large Language Models with Sketching0
Leveraging Grammar Induction for Language Understanding and GenerationCode0
Collapsed Language Models Promote FairnessCode0
LoRTA: Low Rank Tensor Adaptation of Large Language Models0
CodePMP: Scalable Preference Model Pretraining for Large Language Model Reasoning0
Addition is All You Need for Energy-efficient Language Models0
Experimental Evaluation of Machine Learning Models for Goal-oriented Customer Service Chatbot with Pipeline Architecture0
Robotic-CLIP: Fine-tuning CLIP on Action Data for Robotic Applications0
Towards Enhancing Linked Data Retrieval in Conversational UIs using Large Language ModelsCode0
Improving the Efficiency of Visually Augmented Language ModelsCode0
Safeguarding Decentralized Social Media: LLM Agents for Automating Community Rule Compliance0
LLM-based Weak Supervision Framework for Query Intent Classification in Video Search0
Logically Consistent Language Models via Neuro-Symbolic Integration0
SVFit: Parameter-Efficient Fine-Tuning of Large Pre-Trained Models Using Singular Values0
Evaluating Large Language Models with Tests of Spanish as a Foreign Language: Pass or Fail?0
Large Margin Prototypical Network for Few-shot Relation Classification with Fine-grained Features0
Prompt-based Personality Profiling: Reinforcement Learning for Relevance Filtering0
R2GQA: Retriever-Reader-Generator Question Answering System to Support Students Understanding Legal Regulations in Higher Education0
LLM-GAN: Construct Generative Adversarial Network Through Large Language Models For Explainable Fake News Detection0
The Dark Side of Human Feedback: Poisoning Large Language Models via User Inputs0
A Survey for Large Language Models in Biomedicine0
Making the Most of your Model: Methods for Finetuning and Applying Pretrained Transformers0
EMP: Enhance Memory in Data Pruning0
AAVENUE: Detecting LLM Biases on NLU Tasks in AAVE via a Novel Benchmark0
Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language ModelsCode0
Evaluating Large Language Models on Spatial Tasks: A Multi-Task Benchmarking Study0
Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates0
GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding0
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLUCode0
Evaluating Fine-Tuning Efficiency of Human-Inspired Learning Strategies in Medical Question AnsweringCode0
Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation0
Only One Relation Possible? Modeling the Ambiguity in Event Temporal Relation Extraction0
Show:102550
← PrevPage 12 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified