SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Showing 201250 of 1961 papers

TitleStatusHype
ConjNLI: Natural Language Inference Over Conjunctive SentencesCode1
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From CharactersCode1
UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System MetathesaurusCode1
Improving Factual Completeness and Consistency of Image-to-Text Radiology Report GenerationCode1
Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense GraphsCode1
Cross-Modal BERT for Text-Audio Sentiment AnalysisCode1
Evaluating Factuality in Generation with Dependency-level EntailmentCode1
Social Commonsense Reasoning with Multi-Head Knowledge AttentionCode1
From Hero to Zéroe: A Benchmark of Low-Level Adversarial AttacksCode1
OCNLI: Original Chinese Natural Language InferenceCode1
Cross-Thought for Sentence Encoder Pre-trainingCode1
What Can We Learn from Collective Human Opinions on Natural Language Inference Data?Code1
Universal Natural Language Processing with Limited Annotations: Try Few-shot Textual Entailment as a StartCode1
Poison Attacks against Text Datasets with Conditional Adversarially Regularized AutoencoderCode1
InfoBERT: Improving Robustness of Language Models from An Information Theoretic PerspectiveCode1
Mining Knowledge for Natural Language Inference from Wikipedia CategoriesCode1
TaxiNLI: Taking a Ride up the NLU HillCode1
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less DataCode1
FarsTail: A Persian Natural Language Inference DatasetCode1
Generating Label Cohesive and Well-Formed Adversarial ClaimsCode1
GREEK-BERT: The Greeks visiting Sesame StreetCode1
Big Bird: Transformers for Longer SequencesCode1
An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language ModelsCode1
Transferability of Natural Language Inference to Biomedical Question AnsweringCode1
Towards Holistic and Automatic Evaluation of Open-Domain Dialogue GenerationCode1
Compositional Explanations of NeuronsCode1
M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-trainingCode1
NILE : Natural Language Inference with Faithful Natural Language ExplanationsCode1
L2R2: Leveraging Ranking for Abductive ReasoningCode1
Stance Prediction and Claim Verification: An Arabic PerspectiveCode1
Logical Inferences with Comparatives and Generalized QuantifiersCode1
Explaining Black Box Predictions and Unveiling Data Artifacts through Influence FunctionsCode1
What Do Questions Exactly Ask? MFAE: Duplicate Question Identification with Multi-Fusion Asking EmphasisCode1
How Does Selective Mechanism Improve Self-Attention Networks?Code1
On Faithfulness and Factuality in Abstractive SummarizationCode1
Massively Multilingual Sparse Word RepresentationsCode1
Distributionally Robust Neural NetworksCode1
KLEJ: Comprehensive Benchmark for Polish Language UnderstandingCode1
An Empirical Study of Pre-trained Transformers for Arabic Information ExtractionCode1
Data and Representation for Turkish Natural Language InferenceCode1
Syntactic Data Augmentation Increases Robustness to Inference HeuristicsCode1
New Protocols and Negative Results for Textual Entailment Data CollectionCode1
The Right Tool for the Job: Matching Model and Instance ComplexitiesCode1
Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-ConsciousnessCode1
e-SNLI-VE: Corrected Visual-Textual Entailment with Natural Language ExplanationsCode1
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionCode1
KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language UnderstandingCode1
Deep Learning Based Text Classification: A Comprehensive ReviewCode1
Evaluating Multimodal Representations on Visual Semantic Textual SimilarityCode1
Calibration of Pre-trained TransformersCode1
Show:102550
← PrevPage 5 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5Unverified
3Neural Tree Indexers for Text Understanding% Test Accuracy93.1Unverified
4EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1Unverified
5RoBERTa-large+Self-Explaining% Test Accuracy92.3Unverified
6RoBERTa-large + self-explaining layer% Test Accuracy92.3Unverified
7CA-MTL% Test Accuracy92.1Unverified
8SemBERT% Test Accuracy91.9Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96Unverified
2PaLM 540B (fine-tuned)Accuracy95.7Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5Unverified
5DeBERTa-1.5BAccuracy93.2Unverified
6MUPPET Roberta LargeAccuracy92.8Unverified
7DeBERTaV3largeAccuracy92.7Unverified
8T5-XXL 11B (fine-tuned)Accuracy92.5Unverified
9T5-XXL 11BAccuracy92.5Unverified
10ST-MoE-L 4.1B (fine-tuned)Accuracy92.1Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6Unverified
3T5-XXL 11B (fine-tuned)Matched92Unverified
4T5Matched92Unverified
5T5-11BMismatched91.7Unverified
6T5-3BMatched91.4Unverified
7ALBERTMatched91.3Unverified
8Adv-RoBERTa ensembleMatched91.1Unverified
9DeBERTa (large)Matched91.1Unverified
10SMARTRoBERTaDev Matched91.1Unverified