SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 551600 of 1978 papers

TitleStatusHype
MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language ModelsCode1
Is Prompt-Based Finetuning Always Better than Vanilla Finetuning? Insights from Cross-Lingual Language UnderstandingCode0
A Dialogue System for Assessing Activities of Daily Living: Improving Consistency with Grounded Knowledge0
Improving BERT with Hybrid Pooling Network and Drop Mask0
VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street ViewCode1
BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamsCode1
Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work0
ScriptWorld: Text Based Environment For Learning Procedural KnowledgeCode1
Teach Me How to Learn: A Perspective Review towards User-centered Neuro-symbolic Learning for Robotic Surgical Systems0
Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation0
Distilling Large Vision-Language Model with Out-of-Distribution GeneralizabilityCode1
In-Context Learning for Attention Scheme: from Single Softmax Regression to Multiple Softmax Regression via a Tensor Trick0
HeGeL: A Novel Dataset for Geo-Location from Hebrew TextCode0
Revisiting Sample Size Determination in Natural Language UnderstandingCode0
A negation detection assessment of GPTs: analysis with the xNot360 dataset0
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills0
Training Transformers with 4-bit IntegersCode1
Joint Prompt Optimization of Stacked LLMs using Variational InferenceCode1
Federated Self-Learning with Weak Supervision for Speech Recognition0
LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation0
Surfer: Progressive Reasoning with World Models for Robotic Manipulation0
Adversarial Robustness of Prompt-based Few-Shot Learning for Natural Language UnderstandingCode0
Multilingual Few-Shot Learning via Language Model Retrieval0
Data Selection for Fine-tuning Large Language Models Using Transferred Shapley ValuesCode0
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language ModelsCode0
Generate to Understand for RepresentationCode1
SpeechGLUE: How Well Can Self-Supervised Speech Models Capture Linguistic Knowledge?Code1
Deep Model Compression Also Helps Models Capture AmbiguityCode0
On the N-gram Approximation of Pre-trained Language Models0
Multimodal Audio-textual Architecture for Robust Spoken Language Understanding0
Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT PerspectiveCode1
Leveraging Large Language Models for Scalable Vector Graphics-Driven Image UnderstandingCode0
Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-trainingCode0
InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding0
LogiQA 2.0—An Improved Dataset for Logical Reasoning in Natural Language UnderstandingCode0
Enhancing Language Representation with Constructional Information for Natural Language UnderstandingCode1
bgGLUE: A Bulgarian General Language Understanding Evaluation BenchmarkCode0
A Simple yet Effective Self-Debiasing Framework for Transformer ModelsCode0
Quantization-Aware and Tensor-Compressed Training of Transformers for Natural Language Understanding0
Automatic Glossary of Clinical Terminology: a Large-Scale Dictionary of Biomedical Definitions Generated from Ontological Knowledge0
Inspecting Spoken Language Understanding from Kids for Basic Math Learning at Home0
FlexRound: Learnable Rounding based on Element-wise Division for Post-Training QuantizationCode0
A template-independent approach for information extraction in real estate documentsCode0
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language ModelsCode1
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio GenerationCode1
Tri-level Joint Natural Language Understanding for Multi-turn Conversational DatasetsCode0
Robust Natural Language Understanding with Residual Attention DebiasingCode0
A Unified Framework for Slot based Response Generation in a Multimodal Dialogue SystemCode0
Entailment as Robust Self-LearnerCode1
MERGE: Fast Private Text GenerationCode0
Show:102550
← PrevPage 12 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified