SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Showing 251300 of 1978 papers

TitleStatusHype
CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about NegationCode1
Evolving Attention with Residual ConvolutionsCode1
FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation ModelsCode1
On the Importance of Effectively Adapting Pretrained Language Models for Active LearningCode1
Improving Constituency Parsing with Span AttentionCode1
Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesCode1
Joint Localization and Activation Editing for Low-Resource Fine-TuningCode1
Graph Based Network with Contextualized Representations of Turns in DialogueCode1
Graph Constrained Reinforcement Learning for Natural Language Action SpacesCode1
A Comprehensive Survey on Graph Neural NetworksCode1
Towards General Natural Language Understanding with Probabilistic WorldbuildingCode1
BioBART: Pretraining and Evaluation of A Biomedical Generative Language ModelCode1
GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization PerspectiveCode1
GLGE: A New General Language Generation Evaluation BenchmarkCode1
ChatLog: Carefully Evaluating the Evolution of ChatGPT Across TimeCode1
GLoRE: Evaluating Logical Reasoning of Large Language ModelsCode1
A Persian Benchmark for Joint Intent Detection and Slot FillingCode1
Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingCode1
Causality-aware Concept Extraction based on Knowledge-guided PromptingCode1
Ape210K: A Large-Scale and Template-Rich Dataset of Math Word ProblemsCode1
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuningCode1
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingCode1
How Certain is Your Transformer?Code1
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language UnderstandingCode1
A Generative Model for Joint Natural Language Understanding and GenerationCode1
Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and DesignCode1
GisPy: A Tool for Measuring Gist Inference Score in TextCode1
GLADIS: A General and Large Acronym Disambiguation BenchmarkCode1
FOLIO: Natural Language Reasoning with First-Order LogicCode1
Beyond Autoregression: Fast LLMs via Self-Distillation Through TimeCode1
BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual PolynomialsCode1
BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamsCode1
Form-NLU: Dataset for the Form Natural Language UnderstandingCode1
Capabilities of GPT-4 on Medical Challenge ProblemsCode1
A Toolkit for Generating Code Knowledge GraphsCode1
Bot or Human? Detecting ChatGPT Imposters with A Single QuestionCode1
FlipDA: Effective and Robust Data Augmentation for Few-Shot LearningCode1
Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question DecompositionCode1
ARBML: Democritizing Arabic Natural Language Processing ToolsCode1
Bridging Text and Vision: A Multi-View Text-Vision Registration Approach for Cross-Modal Place RecognitionCode1
FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingCode1
HyperMixer: An MLP-based Low Cost Alternative to TransformersCode1
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP TasksCode1
Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural NetworksCode1
Collaborative Multi-Agent Dialogue Model Training Via Reinforcement LearningCode1
FewCLUE: A Chinese Few-shot Learning Evaluation BenchmarkCode1
Improving Language Understanding by Generative Pre-TrainingCode1
COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsCode1
A Hybrid Architecture for Out of Domain Intent Detection and Intent DiscoveryCode1
A Comprehensive Analysis of Adapter EfficiencyCode1
Show:102550
← PrevPage 6 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90Unverified
2UDSSM-II (ensemble)Accuracy78.3Unverified
3BERT-large 340MAccuracy78.3Unverified
4UDSSM-I (ensemble)Accuracy76.7Unverified
5DSSMAccuracy75Unverified
6UDSSM-IIAccuracy75Unverified
7BERT-base 110M + MASAccuracy68.3Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60Unverified
10Subword-level Transformer LMAccuracy58.3Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5Unverified
2BERT (none)Tags (Full) Acc82Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3Unverified
5RoBERTa + LinearFull F1 (Preps)78.2Unverified
6GloVe (none)Tags (Full) Acc77.5Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6Unverified
2Legal-BERTCaseHOLD75.1Unverified
3DeBERTaCaseHOLD72.1Unverified
4LongformerCaseHOLD72Unverified
5RoBERTaCaseHOLD71.7Unverified
6BERTCaseHOLD70.7Unverified
7BigBirdCaseHOLD70.4Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6Unverified
2ConvBERT-DG + Pre + MultiAverage73.8Unverified
3mslmAverage73.49Unverified
4ConvBERT + Pre + MultiAverage68.22Unverified
5BanLanGenAverage39.16Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89Unverified
2mslmAverage85.83Unverified
3ConvBERT-DG + Pre + MultiAverage85.34Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9Unverified
2BERT-LARGEAverage82.1Unverified