SOTAVerified

Natural Language Understanding

Natural Language Understanding is an important field of Natural Language Processing which contains various tasks such as text classification, natural language inference and story comprehension. Applications enabled by natural language understanding range from question answering to automated reasoning.

Source: Find a Reasonable Ending for Stories: Does Logic Relation Help the Story Cloze Test?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 1978 papers

TitleStatusHype
On Training Data Influence of GPT ModelsCode1
DVMNet++: Rethinking Relative Pose Estimation for Unseen ObjectsCode1
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-TuningCode1
UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language ModelsCode1
Resource-Efficient Transformer Pruning for Finetuning of Large ModelsCode1
Structured Probabilistic CodingCode1
BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual PolynomialsCode1
MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument AnnotationCode1
XplainLLM: A Knowledge-Augmented Dataset for Reliable Grounded Explanations in LLMsCode1
Conic10K: A Challenging Math Problem Understanding and Reasoning DatasetCode1
Automatic Disfluency Detection from Untranscribed SpeechCode1
Instructive Decoding: Instruction-Tuned Large Language Models are Self-Refiner from Noisy InstructionsCode1
Large Language Models are Temporal and Causal Reasoners for Video Question AnsweringCode1
Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language UnderstandingCode1
Split-and-Denoise: Protect large language model inference with local differential privacyCode1
GLoRE: Evaluating Logical Reasoning of Large Language ModelsCode1
PHALM: Building a Knowledge Graph from Scratch by Prompting Humans and a Language ModelCode1
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language ModelsCode1
SEA: Sparse Linear Attention with Estimated Attention MaskCode1
AceGPT, Localizing Large Language Models in ArabicCode1
Natural Language Embedded Programs for Hybrid Language Symbolic ReasoningCode1
LLM4Jobs: Unsupervised occupation extraction and standardization leveraging Large Language ModelsCode1
SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and DialectsCode1
Token-Scaled Logit Distillation for Ternary Weight Generative Language ModelsCode1
Metacognitive Prompting Improves Understanding in Large Language ModelsCode1
Baby's CoThought: Leveraging Large Language Models for Enhanced Reasoning in Compact ModelsCode1
MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language ModelsCode1
VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street ViewCode1
BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamsCode1
ScriptWorld: Text Based Environment For Learning Procedural KnowledgeCode1
Distilling Large Vision-Language Model with Out-of-Distribution GeneralizabilityCode1
Joint Prompt Optimization of Stacked LLMs using Variational InferenceCode1
Training Transformers with 4-bit IntegersCode1
SpeechGLUE: How Well Can Self-Supervised Speech Models Capture Linguistic Knowledge?Code1
Generate to Understand for RepresentationCode1
Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT PerspectiveCode1
Enhancing Language Representation with Constructional Information for Natural Language UnderstandingCode1
Preserving Pre-trained Features Helps Calibrate Fine-tuned Language ModelsCode1
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio GenerationCode1
Entailment as Robust Self-LearnerCode1
C-STS: Conditional Semantic Textual SimilarityCode1
Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language ModelsCode1
WYWEB: A NLP Evaluation Benchmark For Classical ChineseCode1
Understanding Programs by Exploiting (Fuzzing) Test CasesCode1
Question Answering as Programming for Solving Time-Sensitive QuestionsCode1
ZeroSCROLLS: A Zero-Shot Benchmark for Long Text UnderstandingCode1
TESS: Text-to-Text Self-Conditioned Simplex DiffusionCode1
Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal PerspectivesCode1
A Comprehensive Analysis of Adapter EfficiencyCode1
Bot or Human? Detecting ChatGPT Imposters with A Single QuestionCode1
Show:102550
← PrevPage 3 of 40Next →
All datasetsPDP60STREUSLELexGLUEDialoGLUE fewshotDialoGLUE fullGLUE

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1HNNAccuracy90—Unverified
2UDSSM-II (ensemble)Accuracy78.3—Unverified
3BERT-large 340MAccuracy78.3—Unverified
4UDSSM-I (ensemble)Accuracy76.7—Unverified
5DSSMAccuracy75—Unverified
6UDSSM-IIAccuracy75—Unverified
7BERT-base 110M + MASAccuracy68.3—Unverified
8USSM + Supervised Deepnet + 3 Knowledge BasesAccuracy66.7—Unverified
9Word-level CNN+LSTM (full scoring)Accuracy60—Unverified
10Subword-level Transformer LMAccuracy58.3—Unverified
#ModelMetricClaimedVerifiedStatus
1BERT (pred POS/lemmas)Tags (Full) Acc82.5—Unverified
2BERT (none)Tags (Full) Acc82—Unverified
3BERT (gold POS/lemmas)Tags (Full) Acc81—Unverified
4GloVe (gold POS/lemmas)Tags (Full) Acc79.3—Unverified
5RoBERTa + LinearFull F1 (Preps)78.2—Unverified
6GloVe (none)Tags (Full) Acc77.5—Unverified
7GloVe (pred POS/lemmas)Tags (Full) Acc77.1—Unverified
8SVM (feature-rich, gold syntax)Role F1 (Preps)62.2—Unverified
9BiLSTM + MLP (gold syntax)Role F1 (Preps)62.2—Unverified
10SVM (feature-rich, auto syntax)Role F1 (Preps)58.2—Unverified
#ModelMetricClaimedVerifiedStatus
1CaseLaw-BERTCaseHOLD75.6—Unverified
2Legal-BERTCaseHOLD75.1—Unverified
3DeBERTaCaseHOLD72.1—Unverified
4LongformerCaseHOLD72—Unverified
5RoBERTaCaseHOLD71.7—Unverified
6BERTCaseHOLD70.7—Unverified
7BigBirdCaseHOLD70.4—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT-DGAverage74.6—Unverified
2ConvBERT-DG + Pre + MultiAverage73.8—Unverified
3mslmAverage73.49—Unverified
4ConvBERT + Pre + MultiAverage68.22—Unverified
5BanLanGenAverage39.16—Unverified
#ModelMetricClaimedVerifiedStatus
1ConvBERT + Pre + MultiAverage86.89—Unverified
2mslmAverage85.83—Unverified
3ConvBERT-DG + Pre + MultiAverage85.34—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAverage89.9—Unverified
2BERT-LARGEAverage82.1—Unverified