SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 951–1000 of 1961 papers

TitleStatusHype
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence PretrainingCode0
ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference—0
TabPert: An Effective Platform for Tabular PerturbationCode0
KACE: Generating Knowledge Aware Contrastive Explanations for Natural Language Inference—0
Alignment Rationale for Natural Language Inference—0
Zero-shot Event Extraction via Transfer Learning: Challenges and Insights—0
Enhancing Descriptive Image Captioning with Natural Language InferenceCode0
BreakingBERT@IITK at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables—0
AttesTable at SemEval-2021 Task 9: Extending Statement Verification with Tables for Unknown Class, and Semantic Evidence FindingCode0
CASE 2021 Task 2: Zero-Shot Classification of Fine-Grained Sociopolitical Events with Transformer Models—0
COSY: COunterfactual SYntax for Cross-Lingual UnderstandingCode0
Issues with Entailment-based Zero-shot Text ClassificationCode0
Data Augmentation with Adversarial Training for Cross-Lingual NLI—0
IBM MNLP IE at CASE 2021 Task 2: NLI Reranking for Zero-Shot Text Classification—0
HILDIF: Interactive Debugging of NLI Models Using Influence Functions—0
Hybrid Autoregressive Inference for Scalable Multi-hop Explanation RegenerationCode0
Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfer—0
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding—0
From Machine Translation to Code-Switching: Generating High-Quality Code-Switched TextCode0
Transfer Learning for Improving Results on Russian Sentiment DatasetsCode0
Interviewer-Candidate Role Play: Towards Developing Real-World NLP Systems—0
A Joint Training Framework for Open-World Knowledge Graph Embeddings—0
Probing Pre-Trained Language Models for Disease KnowledgeCode0
Counterfactual Maximum Likelihood Estimation for Training Deep NetworksCode0
Embracing Ambiguity: Shifting the Training Target of NLI ModelsCode0
Causal Abstractions of Neural NetworksCode0
Meaning Representation of Numeric Fused-Heads in UCCA—0
Reordering Examples Helps during Priming-based Few-Shot LearningCode0
Language Embeddings for Typology and Cross-lingual Transfer LearningCode0
Figurative Language in Recognizing Textual EntailmentCode0
MedNLI Is Not Immune: Natural Language Inference Artifacts in the Clinical DomainCode0
``I'm Not Mad'': Commonsense Implications of Negation and Contradiction—0
Looking Beyond Sentence-Level Natural Language Inference for Question Answering and Text Summarization—0
ERNIE-NLI: Analyzing the Impact of Domain-Specific External Knowledge on Enhanced Representations for NLI—0
Identifying inherent disagreement in natural language inferenceCode0
Game-theoretic Vocabulary Selection via the Shapley Value and Banzhaf Index—0
Discovering Better Model Architectures for Medical Query Understanding—0
Translate and Classify: Improving Sequence Level Classification for English-Hindi Code-Mixed DataCode0
DReCa: A General Task Augmentation Strategy for Few-Shot Natural Language Inference—0
TaxoClass: Hierarchical Multi-Label Text Classification Using Only Class Names—0
Factoring Statutory Reasoning as Language Understanding Challenges—0
Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual Clues—0
Evaluating Gender Bias in Natural Language InferenceCode0
"Who can help me?": Knowledge Infused Matching of Support Seekers and Support Providers during COVID-19 on Reddit—0
Enhancing Transformers with Gradient Boosted Decision Trees for NLI Fine-TuningCode0
Diff-Explainer: Differentiable Convex Optimization for Explainable Multi-hop Inference—0
Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks—0
Scalar Adjective Identification and Multilingual Ranking—0
Switching Contexts: Transportability Measures for NLPCode0
Finding Fuzziness in Neural Network Models of Language ProcessingCode0
Show:102550
← PrevPage 20 of 40Next →
All datasetsSNLIRTEMultiNLIQNLIANLI testWNLILiDiRusRCBTERRaCommitmentBankSciTailFarsTail

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7—Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5—Unverified
3EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1—Unverified
4Neural Tree Indexers for Text Understanding% Test Accuracy93.1—Unverified
5RoBERTa-large + self-explaining layer% Test Accuracy92.3—Unverified
6RoBERTa-large+Self-Explaining% Test Accuracy92.3—Unverified
7CA-MTL% Test Accuracy92.1—Unverified
8SemBERT% Test Accuracy91.9—Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7—Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96—Unverified
2PaLM 540B (fine-tuned)Accuracy95.7—Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1—Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5—Unverified
5DeBERTa-1.5BAccuracy93.2—Unverified
6MUPPET Roberta LargeAccuracy92.8—Unverified
7DeBERTaV3largeAccuracy92.7—Unverified
8T5-XXL 11B (fine-tuned)Accuracy92.5—Unverified
9T5-XXL 11BAccuracy92.5—Unverified
10UL2 20B (fine-tuned)Accuracy92.1—Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6—Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6—Unverified
3T5-XXL 11B (fine-tuned)Matched92—Unverified
4T5Matched92—Unverified
5T5-11BMismatched91.7—Unverified
6T5-3BMatched91.4—Unverified
7ALBERTMatched91.3—Unverified
8Adv-RoBERTa ensembleMatched91.1—Unverified
9DeBERTa (large)Matched91.1—Unverified
10SMARTRoBERTaDev Matched91.1—Unverified