SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 401–450 of 1961 papers

TitleStatusHype
Conformalized Credal Set PredictorsCode0
Assessing Word Importance Using Models Trained for Semantic TasksCode0
Is Modularity Transferable? A Case Study through the Lens of Knowledge DistillationCode0
Assessment and manipulation of latent constructs in pre-trained language models using psychometric scalesCode0
Learning to Select from Multiple OptionsCode0
Comparing Text Representations: A Theory-Driven ApproachCode0
A MISMATCHED Benchmark for Scientific Natural Language InferenceCode0
Constructing a Natural Language Inference Dataset using Generative Neural NetworksCode0
From Alignment to Entailment: A Unified Textual Entailment Framework for Entity AlignmentCode0
Forget NLI, Use a Dictionary: Zero-Shot Topic Classification for Low-Resource Languages with Application to LuxembourgishCode0
Frame- and Entity-Based Knowledge for Common-Sense Argumentative ReasoningCode0
Continual Few-Shot Learning for Text ClassificationCode0
Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and ApproachesCode0
FlauBERT: Unsupervised Language Model Pre-training for FrenchCode0
Flexible Natural Language-Based Image Data Downlink Prioritization for NanosatellitesCode0
Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation TasksCode0
Fine-grained Entailment: Resources for Greek NLI and Precise EntailmentCode0
Combining Similarity Features and Deep Representation Learning for Stance Detection in the Context of Checking Fake NewsCode0
ASCM: An Answer Space Clustered Prompting Method without Answer EngineeringCode0
Fill the GAP: Exploiting BERT for Pronoun ResolutionCode0
CORE: A Retrieve-then-Edit Framework for Counterfactual Data GenerationCode0
Idiom Paraphrases: Seventh Heaven vs Cloud NineCode0
Combining Fact Extraction and Verification with Neural Semantic Matching NetworksCode0
Combining Axiom Injection and Knowledge Base Completion for Efficient Natural Language InferenceCode0
Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations in a Label-Abundant SetupCode0
Figurative Language in Recognizing Textual EntailmentCode0
COSY: COunterfactual SYntax for Cross-Lingual UnderstandingCode0
Co-training for Low Resource Scientific Natural Language InferenceCode0
Counterfactual Adversarial Learning with Representation InterpolationCode0
Counterfactually-Augmented SNLI Training Data Does Not Yield Better Generalization Than Unaugmented DataCode0
Finding Fuzziness in Neural Network Models of Language ProcessingCode0
From Key Points to Key Point Hierarchy: Structured and Expressive Opinion SummarizationCode0
AMRFact: Enhancing Summarization Factuality Evaluation with AMR-Driven Negative Samples GenerationCode0
Improving Sentence Embeddings with Automatic Generation of Training Data Using Few-shot ExamplesCode0
FarFetched: Entity-centric Reasoning and Claim Validation for the Greek Language based on Textually Represented EnvironmentsCode0
ArNLI: Arabic Natural Language Inference for Entailment and Contradiction DetectionCode0
Cross-Lingual Retrieval Augmented Prompt for Low-Resource LanguagesCode0
Inference and Verbalization Functions During In-Context LearningCode0
Code Comment Inconsistency Detection with BERT and LongformerCode0
Falsesum: Generating Document-level NLI Examples for Recognizing Factual Inconsistency in SummarizationCode0
Adversarial Self-Attention for Language UnderstandingCode0
Fake News Detection as Natural Language InferenceCode0
Extracting and Encoding: Leveraging Large Language Models and Medical Knowledge to Enhance Radiological Text RepresentationCode0
Exploring Transitivity in Neural NLI Models through VeridicalityCode0
Cross-Pair Text Representations for Answer Sentence SelectionCode0
Investigating Reasons for Disagreement in Natural Language InferenceCode0
Extracting and filtering paraphrases by bridging natural language inference and paraphrasingCode0
FastTrees: Parallel Latent Tree-Induction for Faster Sequence EncodingCode0
Augmenting Legal Decision Support Systems with LLM-based NLI for Analyzing Social Media EvidenceCode0
Exploring Robustness of Multilingual LLMs on Real-World Noisy DataCode0
Show:102550
← PrevPage 9 of 40Next →
All datasetsSNLIRTEMultiNLIQNLIANLI testWNLILiDiRusRCBTERRaCommitmentBankSciTailFarsTail

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7—Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5—Unverified
3Neural Tree Indexers for Text Understanding% Test Accuracy93.1—Unverified
4EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1—Unverified
5RoBERTa-large+Self-Explaining% Test Accuracy92.3—Unverified
6RoBERTa-large + self-explaining layer% Test Accuracy92.3—Unverified
7CA-MTL% Test Accuracy92.1—Unverified
8SemBERT% Test Accuracy91.9—Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7—Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6—Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96—Unverified
2PaLM 540B (fine-tuned)Accuracy95.7—Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1—Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5—Unverified
5DeBERTa-1.5BAccuracy93.2—Unverified
6MUPPET Roberta LargeAccuracy92.8—Unverified
7DeBERTaV3largeAccuracy92.7—Unverified
8T5-XXL 11B (fine-tuned)Accuracy92.5—Unverified
9T5-XXL 11BAccuracy92.5—Unverified
10ST-MoE-L 4.1B (fine-tuned)Accuracy92.1—Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6—Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6—Unverified
3T5-XXL 11B (fine-tuned)Matched92—Unverified
4T5Matched92—Unverified
5T5-11BMismatched91.7—Unverified
6T5-3BMatched91.4—Unverified
7ALBERTMatched91.3—Unverified
8Adv-RoBERTa ensembleMatched91.1—Unverified
9DeBERTa (large)Matched91.1—Unverified
10SMARTRoBERTaDev Matched91.1—Unverified