SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1551–1600 of 1961 papers

TitleStatusHype
Estimation of Discourse Segmentation Labels from Crowd Data—0
ETS: Domain Adaptation and Stacking for Short Answer Scoring—0
Evaluating and Modeling Attribution for Cross-Lingual Question Answering—0
Evaluating BERT for natural language inference: A case study on the CommitmentBank—0
Evaluating Compound Splitters Extrinsically with Textual Entailment—0
Evaluating Hierarchies of Verb Argument Structure with Hierarchical Clustering—0
Evaluating language understanding accuracy with respect to objective outcomes in a dialogue system—0
Evaluating Large Language Models Using Contrast Sets: An Experimental Approach—0
Evaluating Paraphrastic Robustness in Textual Entailment Models—0
Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks—0
Evaluation for Partial Event Coreference—0
Evaluation of BERT and ALBERT Sentence Embedding Performance on Downstream NLP Tasks—0
Evaluation of OpenAI o1: Opportunities and Challenges of AGI—0
ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference—0
Excitatory or Inhibitory: A New Semantic Orientation Extracts Contradiction and Causality from the Web—0
Experimenting AI Technologies for Disinformation Combat: the IDMO Project—0
Case-Based Abductive Natural Language Inference—0
Explainable Procedural Mistake Detection—0
Explaining and Improving Model Behavior with k Nearest Neighbor Representations—0
Explaining Mixtures of Sources in News Articles—0
Explaining Predictive Uncertainty by Looking Back at Model Explanations—0
Explanation based Bias Decoupling Regularization for Natural Language Inference—0
Explicating the Implicit: Argument Detection Beyond Sentence Boundaries—0
Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language Inference—0
Exploiting Image Generality for Lexical Entailment Detection—0
Exploiting Language Models as a Source of Knowledge for Cognitive Agents—0
Exploiting Open IE for Deriving Multiple Premises Entailment Corpus—0
Exploiting Qualitative Information from Automatic Word Alignment for Cross-lingual NLP Tasks—0
Exploiting Sentence Similarities for Better Alignments—0
Exploiting Timegraphs in Temporal Relation Classification—0
Exploring Factual Entailment with NLI: A News Media Study—0
Exploring Fine-grained Entity Type Constraints for Distantly Supervised Relation Extraction—0
Exploring Lexical Irregularities in Hypothesis-Only Models of Natural Language Inference—0
Exploring Lexical, Syntactic, and Semantic Features for Chinese Textual Entailment in NTCIR RITE Evaluation Tasks—0
Exploring the Boundaries of GPT-4 in Radiology—0
Exploring the Effectiveness of Instruction Tuning in Biomedical Language Processing—0
Exploring the Influence of Dialog Input Format for Unsupervised Clinical Questionnaire Filling—0
Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Data—0
Exploring the use of word embeddings and random walks on Wikipedia for the CogAlex shared task—0
Expressivity and comparison of models of discourse structure—0
Extracting Context-Rich Entailment Rules from Wikipedia Revision History—0
Extractive NarrativeQA with Heuristic Pre-Training—0
FaBERT: Pre-training BERT on Persian Blogs—0
FactCheck Editor: Multilingual Text Editor with End-to-End fact-checking—0
FacTeR-Check: Semi-automated fact-checking through Semantic Similarity and Natural Language Inference—0
FACTOID: FACtual enTailment fOr hallucInation Detection—0
Factoring Statutory Reasoning as Language Understanding Challenges—0
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback—0
Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations—0
Fake news stance detection using stacked ensemble of classifiers—0
Show:102550
← PrevPage 32 of 40Next →
All datasetsSNLIRTEMultiNLIQNLIANLI testWNLILiDiRusRCBTERRaCommitmentBankSciTailFarsTail

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7—Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5—Unverified
3EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1—Unverified
4Neural Tree Indexers for Text Understanding% Test Accuracy93.1—Unverified
5RoBERTa-large+Self-Explaining% Test Accuracy92.3—Unverified
6RoBERTa-large + self-explaining layer% Test Accuracy92.3—Unverified
7CA-MTL% Test Accuracy92.1—Unverified
8SemBERT% Test Accuracy91.9—Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7—Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96—Unverified
2PaLM 540B (fine-tuned)Accuracy95.7—Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1—Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5—Unverified
5DeBERTa-1.5BAccuracy93.2—Unverified
6MUPPET Roberta LargeAccuracy92.8—Unverified
7DeBERTaV3largeAccuracy92.7—Unverified
8T5-XXL 11BAccuracy92.5—Unverified
9T5-XXL 11B (fine-tuned)Accuracy92.5—Unverified
10ST-MoE-L 4.1B (fine-tuned)Accuracy92.1—Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6—Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6—Unverified
3T5-XXL 11B (fine-tuned)Matched92—Unverified
4T5Matched92—Unverified
5T5-11BMismatched91.7—Unverified
6T5-3BMatched91.4—Unverified
7ALBERTMatched91.3—Unverified
8DeBERTa (large)Matched91.1—Unverified
9Adv-RoBERTa ensembleMatched91.1—Unverified
10SMARTRoBERTaDev Matched91.1—Unverified