SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 51100 of 1978 papers

TitleStatusHype
Parameter-Efficient Fine-Tuning with Discrete Fourier TransformCode2
BEVDriver: Leveraging BEV Maps in LLMs for Robust Closed-Loop DrivingCode2
PERT: Pre-training BERT with Permuted Language ModelCode2
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsCode2
SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence UnderstandingCode2
MathOdyssey: Benchmarking Mathematical Problem-Solving Skills in Large Language Models Using Odyssey Math DataCode2
MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language ModelsCode2
Balancing LoRA Performance and Efficiency with Simple Shard SharingCode2
PMC-LLaMA: Towards Building Open-source Language Models for MedicineCode2
The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QACode2
LoRA-Pro: Are Low-Rank Adapters Properly Optimized?Code2
Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and OpportunitiesCode2
LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank AdaptationCode2
JGLUE: Japanese General Language Understanding EvaluationCode2
An empirical study of LLaMA3 quantization: from LLMs to MLLMsCode2
BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsCode2
I-BERT: Integer-only BERT QuantizationCode2
Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU TasksCode2
GPT Understands, TooCode2
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingCode2
DeBERTa: Decoding-enhanced BERT with Disentangled AttentionCode2
DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AICode2
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization AlignmentCode2
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersCode2
Large Language Model Safety: A Holistic SurveyCode2
Autonomous GIS: the next-generation AI-powered GISCode2
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization ApproachCode1
Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language ModelsCode1
Cross-Lingual Semantic Role Labeling with High-Quality Translated Training CorpusCode1
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and GenerationCode1
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language ModelsCode1
CREAK: A Dataset for Commonsense Reasoning over Entity KnowledgeCode1
CSKG: The CommonSense Knowledge GraphCode1
Conic10K: A Challenging Math Problem Understanding and Reasoning DatasetCode1
Advances of Transformer-Based Models for News Headline GenerationCode1
ConvBERT: Improving BERT with Span-based Dynamic ConvolutionCode1
CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about NegationCode1
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language ModelsCode1
ConFiguRe: Exploring Discourse-level Chinese Figures of SpeechCode1
Convolution-enhanced Evolving Attention NetworksCode1
C-STS: Conditional Semantic Textual SimilarityCode1
CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from TextCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
Anno-MI: A Dataset of Expert-Annotated Counselling DialoguesCode1
CLUES: Few-Shot Learning Evaluation in Natural Language UnderstandingCode1
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsCode1
AceGPT, Localizing Large Language Models in ArabicCode1
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language UnderstandingCode1
Causality-aware Concept Extraction based on Knowledge-guided PromptingCode1
A Dataset for Statutory Reasoning in Tax Law Entailment and Question AnsweringCode1
Show:102550
← PrevPage 2 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2BERT-large 340MAccuracy78.3Unverified
3UDSSM-II (ensemble)Accuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified