SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Showing 1–10 of 1961 papers

TitleStatusHype
LRCTI: A Large Language Model-Based Framework for Multi-Step Evidence Retrieval and Reasoning in Cyber Threat Intelligence Credibility Verification—0
DS@GT at CheckThat! 2025: Evaluating Context and Tokenization Strategies for Numerical Fact VerificationCode0
ARAG: Agentic Retrieval Augmented Generation for Personalized Recommendation—0
When Does Meaning Backfire? Investigating the Role of AMRs in NLI—0
Thunder-NUBench: A Benchmark for LLMs' Sentence-Level Negation Understanding—0
Explainable Compliance Detection with Multi-Hop Natural Language Inference on Assurance Case Structure—0
Theorem-of-Thought: A Multi-Agent Framework for Abductive, Deductive, and Inductive Reasoning in Language ModelsCode0
A MISMATCHED Benchmark for Scientific Natural Language InferenceCode0
CLATTER: Comprehensive Entailment Reasoning for Hallucination Detection—0
Drop Dropout on Single-Epoch Language Model PretrainingCode0
Show:102550
← PrevPage 1 of 197Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1CA-MTLAccuracy96.8—Unverified
2MT-DNN-SMARTLARGEv0% Dev Accuracy96.6—Unverified
3MT-DNN-SMART_100%ofTrainingDataDev Accuracy96.1—Unverified
4MT-DNNAccuracy94.1—Unverified
5MT-DNN-SMART_10%ofTrainingDataDev Accuracy91.3—Unverified
6MT-DNN-SMART_1%ofTrainingDataDev Accuracy88.6—Unverified
7Finetuned Transformer LMAccuracy88.3—Unverified
8Finetuned Transformer LMAccuracy88.3—Unverified
9RE2Accuracy86—Unverified
10Hierarchical BiLSTM Max PoolingAccuracy86—Unverified