SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 151200 of 1978 papers

TitleStatusHype
SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video SegmentationCode3
Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey0
Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Models0
LeMoLE: LLM-Enhanced Mixture of Linear Experts for Time Series Forecasting0
Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks0
Transforming NLU with Babylon: A Case Study in Development of Real-time, Edge-Efficient, Multi-Intent Translation System for Automated Drive-Thru Ordering0
Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models0
Neurosymbolic Graph Enrichment for Grounded World Models0
On-Board Vision-Language Models for Personalized Autonomous Vehicle Motion Control: System Design and Real-World Validation0
Hysteresis Activation Function for Efficient InferenceCode0
Med-Bot: An AI-Powered Assistant to Provide Accurate and Reliable Medical Information0
Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understanding0
Synthesize, Partition, then Adapt: Eliciting Diverse Samples from Foundation Models0
HierTOD: A Task-Oriented Dialogue System Driven by Hierarchical Goals0
Evaluating Large Language Models on Financial Report Summarization: An Empirical Study0
Improved intent classification based on context information using a windows-based approach0
GPT Semantic Cache: Reducing LLM Costs and Latency via Semantic Embedding Caching0
Sentiment Analysis of Cyberbullying Data in Social MediaCode0
Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank AdaptationCode0
MEG: Medical Knowledge-Augmented Large Language Models for Question AnsweringCode1
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution0
Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning0
Ontology Population using LLMs0
Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior0
Improving In-Context Learning with Small Language Model EnsemblesCode0
SVIP: Towards Verifiable Inference of Open-source Large Language Models0
Beyond Autoregression: Fast LLMs via Self-Distillation Through TimeCode1
Improving Multimodal Large Language Models Using Continual Learning0
BioMistral-NLU: Towards More Generalizable Medical Language Understanding through Instruction Tuning0
Task Calibration: Calibrating Large Language Models on Inference Tasks0
Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks0
Knowledge Distillation Using Frontier Open-source LLMs: Generalizability and the Role of Synthetic Data0
Jailbreaking and Mitigation of Vulnerabilities in Large Language Models0
Large Language Models for Autonomous Driving (LLM4AD): Concept, Benchmark, Experiments, and Challenges0
MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations0
SLM-Mod: Small Language Models Surpass LLMs at Content ModerationCode0
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-TuningCode0
VL-GLUE: A Suite of Fundamental yet Challenging Visuo-Linguistic Reasoning TasksCode0
Enhancing Text Generation in Joint NLG/NLU Learning Through Curriculum Learning, Semi-Supervised Training, and Advanced Optimization Techniques0
Expanding Chatbot Knowledge in Customer Service: Context-Aware Similar Question Generation Using Large Language Models0
PromptExp: Multi-granularity Prompt Explanation of Large Language Models0
Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning0
SplitLLM: Collaborative Inference of LLMs for Model Placement and Throughput Optimization0
BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation0
TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretraining0
MTL-LoRA: Low-Rank Adaptation for Multi-Task LearningCode1
FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation ModelsCode1
SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight CompressionCode1
StraGo: Harnessing Strategic Guidance for Prompt Optimization0
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt TuningCode0
Show:102550
← PrevPage 4 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified