SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 751–800 of 1961 papers

TitleStatusHype
Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy LogicCode0
Language Models as a Knowledge Source for Cognitive Agents—0
General Cross-Architecture Distillation of Pretrained Language Models into Matrix EmbeddingsCode0
Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human RatingsCode0
Comparing Text Representations: A Theory-Driven ApproachCode0
On the Language-specificity of Multilingual BERT and the Impact of Fine-tuningCode0
Task-adaptive Pre-training and Self-training are Complementary for Natural Language Understanding—0
Graph-based Retrieval for Claim Verification over Cross-Document Evidence—0
Pairwise Supervised Contrastive Learning of Sentence RepresentationsCode1
Counterfactual Adversarial Learning with Representation InterpolationCode0
How May I Help You? Using Neural Text Simplification to Improve Downstream NLP TasksCode0
Subword Mapping and Anchoring across LanguagesCode1
SPECTRA: Sparse Structured Text RationalizationCode1
Learning with Different Amounts of Annotation: From Zero to Many LabelsCode0
ARMAN: Pre-training with Semantically Selecting and Reordering of Sentences for Persian Abstractive SummarizationCode1
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction—0
Cross-Policy Compliance Detection via Question Answering—0
Discrete and Soft Prompting for Multilingual ModelsCode1
Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference—0
Finetuned Language Models Are Zero-Shot LearnersCode3
Do Prompt-Based Models Really Understand the Meaning of their Prompts?Code0
Siamese Networks for Inference in Malayalam Language Texts—0
Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty EstimationCode0
A Generative Approach for Mitigating Structural Biases in Natural Language InferenceCode0
ProoFVer: Natural Logic Theorem Proving for Fact VerificationCode1
Prompt-Learning for Fine-Grained Entity Typing—0
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text MiningCode1
Tailor: Generating and Perturbing Text with Semantic Controls—0
Differentiable Subset Pruning of Transformer HeadsCode1
LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching—0
EENLP: Cross-lingual Eastern European NLP IndexCode1
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence PretrainingCode0
ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference—0
TabPert: An Effective Platform for Tabular PerturbationCode0
HILDIF: Interactive Debugging of NLI Models Using Influence Functions—0
CASE 2021 Task 2: Zero-Shot Classification of Fine-Grained Sociopolitical Events with Transformer Models—0
IBM MNLP IE at CASE 2021 Task 2: NLI Reranking for Zero-Shot Text Classification—0
Data Augmentation with Adversarial Training for Cross-Lingual NLI—0
COSY: COunterfactual SYntax for Cross-Lingual UnderstandingCode0
KACE: Generating Knowledge Aware Contrastive Explanations for Natural Language Inference—0
Alignment Rationale for Natural Language Inference—0
Enhancing Descriptive Image Captioning with Natural Language InferenceCode0
Issues with Entailment-based Zero-shot Text ClassificationCode0
Zero-shot Event Extraction via Transfer Learning: Challenges and Insights—0
BreakingBERT@IITK at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables—0
AttesTable at SemEval-2021 Task 9: Extending Statement Verification with Tables for Unknown Class, and Semantic Evidence FindingCode0
Towards Robustness Against Natural Language Word SubstitutionsCode1
Hybrid Autoregressive Inference for Scalable Multi-hop Explanation RegenerationCode0
Modelling Latent Translations for Cross-Lingual TransferCode1
Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfer—0
Show:102550
← PrevPage 16 of 40Next →
All datasetsSNLIRTEMultiNLIQNLIANLI testWNLILiDiRusRCBTERRaCommitmentBankSciTailFarsTail

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7—Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5—Unverified
3EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1—Unverified
4Neural Tree Indexers for Text Understanding% Test Accuracy93.1—Unverified
5RoBERTa-large+Self-Explaining% Test Accuracy92.3—Unverified
6RoBERTa-large + self-explaining layer% Test Accuracy92.3—Unverified
7CA-MTL% Test Accuracy92.1—Unverified
8SemBERT% Test Accuracy91.9—Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7—Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96—Unverified
2PaLM 540B (fine-tuned)Accuracy95.7—Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1—Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5—Unverified
5DeBERTa-1.5BAccuracy93.2—Unverified
6MUPPET Roberta LargeAccuracy92.8—Unverified
7DeBERTaV3largeAccuracy92.7—Unverified
8T5-XXL 11BAccuracy92.5—Unverified
9T5-XXL 11B (fine-tuned)Accuracy92.5—Unverified
10ST-MoE-L 4.1B (fine-tuned)Accuracy92.1—Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6—Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6—Unverified
3T5-XXL 11B (fine-tuned)Matched92—Unverified
4T5Matched92—Unverified
5T5-11BMismatched91.7—Unverified
6T5-3BMatched91.4—Unverified
7ALBERTMatched91.3—Unverified
8DeBERTa (large)Matched91.1—Unverified
9Adv-RoBERTa ensembleMatched91.1—Unverified
10SMARTRoBERTaDev Matched91.1—Unverified