SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Showing 15511600 of 1961 papers

TitleStatusHype
Neural Natural Logic Inference for Interpretable Question AnsweringCode0
Generating Persona Consistent Dialogues by Exploiting Natural Language InferenceCode0
Neural Network Models for Paraphrase Identification, Semantic Textual Similarity, Natural Language Inference, and Question AnsweringCode0
AMR4NLI: Interpretable and robust NLI measures from semantic graphsCode0
Evaluating Gender Bias of Pre-trained Language Models in Natural Language Inference by Considering All LabelsCode0
Neural Semantic EncodersCode0
Evaluating Gender Bias in Natural Language InferenceCode0
GIST at SemEval-2018 Task 12: A network transferring inference knowledge to Argument Reasoning Comprehension taskCode0
Large Language Models can Contrastively Refine their Generation for Better Sentence Representation LearningCode0
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous SpaceCode0
Neural Tree Indexers for Text UnderstandingCode0
Annotating and analyzing the interactions between meaning relationsCode0
GLoMo: Unsupervisedly Learned Relational Graphs as Transferable RepresentationsCode0
Evaluating Compositionality in Sentence EmbeddingsCode0
XNLI: Evaluating Cross-lingual Sentence RepresentationsCode0
Neuro-symbolic Natural Logic with Introspective Revision for Natural Language InferenceCode0
Neutralizing Bias in LLM Reasoning using Entailment GraphsCode0
GPT-HateCheck: Can LLMs Write Better Functional Tests for Hate Speech Detection?Code0
New Datasets for Automatic Detection of Textual Entailment and of Contradictions between Sentences in FrenchCode0
Semantic Relatedness Based Re-ranker for Text SpottingCode0
Temporal and Aspectual EntailmentCode0
Counterfactual Adversarial Learning with Representation InterpolationCode0
General Cross-Architecture Distillation of Pretrained Language Models into Matrix EmbeddingsCode0
GraphNLI: A Graph-based Natural Language Inference Model for Polarity Prediction in Online DebatesCode0
GreekBART: The First Pretrained Greek Sequence-to-Sequence ModelCode0
Evaluating Coherence in Dialogue Systems using EntailmentCode0
NEZHA: Neural Contextualized Representation for Chinese Language UnderstandingCode0
Grounded Textual EntailmentCode0
ETPC - A Paraphrase Identification Corpus Annotated with Extended Paraphrase Typology and NegationCode0
Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution SimilaritiesCode0
Co-training for Low Resource Scientific Natural Language InferenceCode0
COSY: COunterfactual SYntax for Cross-Lingual UnderstandingCode0
Semantics-aware BERT for Language UnderstandingCode0
Correcting ContradictionsCode0
NLI Data Sanity Check: Assessing the Effect of Data Corruption on Model PerformanceCode0
HellaSwag: Can a Machine Really Finish Your Sentence?Code0
HELP: A Dataset for Identifying Shortcomings of Neural Models in Monotonicity ReasoningCode0
ERNIE: Enhanced Language Representation with Informative EntitiesCode0
Temporal Reasoning in Natural Language InferenceCode0
Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI ModelsCode0
Two Stage Transformer Model for COVID-19 Fake News Detection and Fact CheckingCode0
A MISMATCHED Benchmark for Scientific Natural Language InferenceCode0
Testing Pre-trained Language Models' Understanding of Distributivity via Causal Mediation AnalysisCode0
EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language InferenceCode0
How Do Humans Write Code? Large Models Do It the Same Way TooCode0
TwoWingOS: A Two-Wing Optimization Strategy for Evidential Claim VerificationCode0
Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal NegationCode0
Text Counterfactuals via Latent Optimization and Shapley-Guided SearchCode0
How Hard is this Test Set? NLI Characterization by Exploiting Training DynamicsCode0
How May I Help You? Using Neural Text Simplification to Improve Downstream NLP TasksCode0
Show:102550
← PrevPage 32 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5Unverified
3Neural Tree Indexers for Text Understanding% Test Accuracy93.1Unverified
4EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1Unverified
5RoBERTa-large+Self-Explaining% Test Accuracy92.3Unverified
6RoBERTa-large + self-explaining layer% Test Accuracy92.3Unverified
7CA-MTL% Test Accuracy92.1Unverified
8SemBERT% Test Accuracy91.9Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96Unverified
2PaLM 540B (fine-tuned)Accuracy95.7Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5Unverified
5DeBERTa-1.5BAccuracy93.2Unverified
6MUPPET Roberta LargeAccuracy92.8Unverified
7DeBERTaV3largeAccuracy92.7Unverified
8T5-XXL 11B (fine-tuned)Accuracy92.5Unverified
9T5-XXL 11BAccuracy92.5Unverified
10ST-MoE-L 4.1B (fine-tuned)Accuracy92.1Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6Unverified
3T5-XXL 11B (fine-tuned)Matched92Unverified
4T5Matched92Unverified
5T5-11BMismatched91.7Unverified
6T5-3BMatched91.4Unverified
7ALBERTMatched91.3Unverified
8Adv-RoBERTa ensembleMatched91.1Unverified
9DeBERTa (large)Matched91.1Unverified
10SMARTRoBERTaDev Matched91.1Unverified