SOTAVerified

Natural Language Inference

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

| Premise | Label | Hypothesis | | --- | ---| --- | | A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. | | An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. | | A soccer game with multiple males playing. | entailment | Some men are playing a sport. |

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

Papers

Showing 14011450 of 1961 papers

TitleStatusHype
Natural Language Inference with Definition Embedding Considering Context On the Fly0
Multiway Attention Networks for Modeling Sentence PairsCode0
Unsupervised Source Hierarchies for Low-Resource Neural Machine Translation0
BioAMA: Towards an End to End BioMedical Question Answering System0
Enhancing Sentence Embedding with Generalized PoolingCode0
GLoMo: Unsupervisedly Learned Relational Graphs as Transferable RepresentationsCode0
Grounded Textual EntailmentCode0
Neural Network Models for Paraphrase Identification, Semantic Textual Similarity, Natural Language Inference, and Question AnsweringCode0
What Knowledge is Needed to Solve the RTE5 Textual Entailment Challenge?0
Stress Test Evaluation for Natural Language InferenceCode0
Looking Beyond the Surface: A Challenge Set for Reading Comprehension over Multiple Sentences0
Predicting Human Metaphor Paraphrase Judgments with Deep Neural Networks0
Element-wise Bilinear Interaction for Sentence Matching0
ITNLP-ARC at SemEval-2018 Task 12: Argument Reasoning Comprehension with Attention0
GIST at SemEval-2018 Task 12: A network transferring inference knowledge to Argument Reasoning Comprehension taskCode0
SemEval-2018 Task 9: Hypernym Discovery0
Specialising Word Vectors for Lexical EntailmentCode0
Lexical Substitution for Evaluating Compositional Distributional Models0
CSReader at SemEval-2018 Task 11: Multiple Choice Question Answering as Textual Entailment0
Supervised Open Information Extraction0
NLP\_HZ at SemEval-2018 Task 9: a Nearest Neighbor Approach0
GKR: the Graphical Knowledge Representation for semantic parsing0
Literal, Metphorical or Both? Detecting Metaphoricity in Isolated Adjective-Noun Phrases0
TakeLab at SemEval-2018 Task12: Argument Reasoning Comprehension with Skip-Thought Vectors0
Discriminating between Lexico-Semantic Relations with the Specialization Tensor ModelCode0
Semantic Sentence Matching with Densely-connected Recurrent and Co-attentive Information0
Hyperbolic Neural NetworksCode0
Character-based Neural Networks for Sentence Pair ModelingCode0
Sentence Modeling via Multiple Word Embeddings and Multi-level Comparison for Semantic Textual Similarity0
Improved Sentence Modeling using Suffix Bidirectional LSTM0
AdvEntuRe: Adversarial Training for Textual Entailment with Knowledge-Guided ExamplesCode0
Behavior Analysis of NLI Models: Uncovering the Influence of Three Factors on Robustness0
Hypothesis Only Baselines in Natural Language InferenceCode0
Systems' Agreements and Disagreements in Temporal Processing: An Extensive Error Analysis of the TempEval-3 Task0
ESCRITO - An NLP-Enhanced Educational Scoring Toolkit0
DeModify: A Dataset for Analyzing Contextual Constraints on Modifier Deletion0
ETPC - A Paraphrase Identification Corpus Annotated with Extended Paraphrase Typology and NegationCode0
KIT-Multi: A Translation-Oriented Multilingual Embedding Corpus0
English-Basque Statistical and Neural Machine Translation0
Mapping Texts to Scripts: An Entailment Study0
Deep Learning for Entity Matching: A Design Space ExplorationCode0
Sentiment-Stance-Specificity (SSS) Dataset: Identifying Support-based Entailment among Opinions.0
Towards a Gold Standard Corpus for Variable Detection and Linking in Social Science Publications0
Towards AMR-BR: A SemBank for Brazilian Portuguese Language0
A Multi-Domain Framework for Textual Similarity. A Case Study on Question-to-Question and Question-Answering Similarity Tasks0
Semi-Supervised Clustering for Short Answer Scoring0
Fine-grained Semantic Textual Similarity for Serbian0
BASHI: A Corpus of Wall Street Journal Articles Annotated with Bridging Links0
Constructing a Lexicon of Relational Nouns0
A Large Resource of Patterns for Verbal Paraphrases0
Show:102550
← PrevPage 29 of 40Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)% Test Accuracy94.7Unverified
2UnitedSynT5 (335M)% Test Accuracy93.5Unverified
3EFL (Entailment as Few-shot Learner) + RoBERTa-large% Test Accuracy93.1Unverified
4Neural Tree Indexers for Text Understanding% Test Accuracy93.1Unverified
5RoBERTa-large+Self-Explaining% Test Accuracy92.3Unverified
6RoBERTa-large + self-explaining layer% Test Accuracy92.3Unverified
7CA-MTL% Test Accuracy92.1Unverified
8SemBERT% Test Accuracy91.9Unverified
9MT-DNN-SMARTLARGEv0% Test Accuracy91.7Unverified
10MT-DNN-SMART_100%ofTrainingDataDev Accuracy91.6Unverified
#ModelMetricClaimedVerifiedStatus
1Vega v2 6B (KD-based prompt transfer)Accuracy96Unverified
2PaLM 540B (fine-tuned)Accuracy95.7Unverified
3Turing NLR v5 XXL 5.4B (fine-tuned)Accuracy94.1Unverified
4ST-MoE-32B 269B (fine-tuned)Accuracy93.5Unverified
5DeBERTa-1.5BAccuracy93.2Unverified
6MUPPET Roberta LargeAccuracy92.8Unverified
7DeBERTaV3largeAccuracy92.7Unverified
8T5-XXL 11BAccuracy92.5Unverified
9T5-XXL 11B (fine-tuned)Accuracy92.5Unverified
10ST-MoE-L 4.1B (fine-tuned)Accuracy92.1Unverified
#ModelMetricClaimedVerifiedStatus
1UnitedSynT5 (3B)Matched92.6Unverified
2Turing NLR v5 XXL 5.4B (fine-tuned)Matched92.6Unverified
3T5-XXL 11B (fine-tuned)Matched92Unverified
4T5Matched92Unverified
5T5-11BMismatched91.7Unverified
6T5-3BMatched91.4Unverified
7ALBERTMatched91.3Unverified
8DeBERTa (large)Matched91.1Unverified
9Adv-RoBERTa ensembleMatched91.1Unverified
10SMARTRoBERTaDev Matched91.1Unverified