SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 351400 of 1978 papers

TitleStatusHype
PURPLE: Making a Large Language Model a Better SQL Writer0
Are LLMs Effective Backbones for Fine-tuning? An Experimental Investigation of Supervised LLMs on Chinese Short Text Matching0
Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning?0
Engineering Safety Requirements for Autonomous Driving with Large Language Models0
VLUE: A New Benchmark and Multi-task Knowledge Transfer Learning for Vietnamese Natural Language Understanding0
Towards Knowledge-Grounded Natural Language Understanding and Generation0
MasonTigers at SemEval-2024 Task 9: Solving Puzzles with an Ensemble of Chain-of-Thoughts0
Do Not Worry if You Do Not Have Data: Building Pretrained Language Models Using Translationese0
DVMNet++: Rethinking Relative Pose Estimation for Unseen ObjectsCode1
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models0
Energy-Based Models with Applications to Speech and Language Processing0
EXPLORER: Exploration-guided Reasoning for Textual Reinforcement LearningCode0
Incorporating Graph Attention Mechanism into Geometric Problem Solving Based on Deep Reinforcement LearningCode0
AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning0
CleanAgent: Automating Data Standardization with LLM-based AgentsCode2
Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning0
Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similarity0
Semi-Supervised Dialogue Abstractive Summarization via High-Quality Pseudolabel SelectionCode0
Towards Democratized Flood Risk Management: An Advanced AI Assistant Enabled by GPT-4 for Enhanced Interpretability and Public EngagementCode0
Decomposed Meta-Learning for Few-Shot Sequence LabelingCode0
SciAssess: Benchmarking LLM Proficiency in Scientific Literature AnalysisCode2
NusaBERT: Teaching IndoBERT to be Multilingual and MulticulturalCode0
IAI MovieBot 2.0: An Enhanced Research Platform with Trainable Neural Components and Transparent User ModelingCode0
When does word order matter and when doesn't it?Code0
SynGhost: Invisible and Universal Task-agnostic Backdoor Attack via Syntactic TransferCode0
The First Place Solution of WSDM Cup 2024: Leveraging Large Language Models for Conversational Multi-Doc QACode2
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-TuningCode1
Integrating Large Language Models with Graphical Session-Based Recommendation0
Layer-wise Regularized Dropout for Neural Language Models0
C^3: Confidence Calibration Model Cascade for Inference-Efficient Cross-Lingual Natural Language Understanding0
Executing Natural Language-Described Algorithms with Large Language Models: An InvestigationCode0
Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matching0
UMBCLU at SemEval-2024 Task 1A and 1C: Semantic Textual Relatedness with and without machine translationCode0
NEO-BENCH: Evaluating Robustness of Large Language Models with NeologismsCode0
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks0
Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answering0
An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model InferenceCode0
LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using UncertaintyCode0
UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language ModelsCode1
Punctuation Restoration Improves Structure Understanding Without SupervisionCode0
Privacy-Preserving Language Model Inference with Instance Obfuscation0
ViGoR: Improving Visual Grounding of Large Vision Language Models with Fine-Grained Reward ModelingCode0
FaBERT: Pre-training BERT on Persian Blogs0
LB-KBQA: Large-language-model and BERT based Knowledge-Based Question and Answering System0
Linguistic features for sentence difficulty prediction in ABSA0
"What's my model inside of?": Exploring the role of environments for grounded natural language understanding0
Digits micro-model for accurate and secure transactions0
The Impact of Language Adapters in Cross-Lingual Transfer for NLUCode0
Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks0
BPDec: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining0
Show:102550
← PrevPage 8 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified