SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 17011750 of 2381 papers

TitleStatusHype
LSIS at SemEval-2017 Task 4: Using Adapted Sentiment Similarity Seed Words For English and Arabic Tweet Polarity Classification0
Sew-Embed at SemEval-2017 Task 2: Language-Independent Concept Representations from a Semantically Enriched WikipediaCode0
RTM at SemEval-2017 Task 1: Referential Translation Machines for Predicting Semantic Similarity0
HHU at SemEval-2017 Task 2: Fast Hash-Based Embeddings for Semantic Word Similarity Assessment0
ITNLP-AiKF at SemEval-2017 Task 1: Rich Features Based SVR for Semantic Textual Similarity Computing0
Jmp8 at SemEval-2017 Task 2: A simple and general distributional approach to estimate word similarityCode0
MITRE at SemEval-2017 Task 1: Simple Semantic Similarity0
ResSim at SemEval-2017 Task 1: Multilingual Word Representations for Semantic Textual Similarity0
LIM-LIG at SemEval-2017 Task1: Enhancing the Semantic Similarity for Arabic Sentences with Vectors Weighting0
SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused EvaluationCode1
Determining Semantic Textual Similarity using Natural Deduction Proofs0
Image Pivoting for Learning Multilingual Multimodal Representations0
Visually Aligned Word Embeddings for Improving Zero-shot Learning0
BIOSSES: A Semantic Sentence Similarity Estimation System for the Biomedical Domain0
A Semantics-Based Measure of Emoji SimilarityCode0
Generalized Semantic Preserving Hashing for N-Label Cross-Modal Retrieval0
Beyond Instance-Level Image Retrieval: Leveraging Captions to Learn a Global Visual Representation for Semantic Retrieval0
Online Asymmetric Similarity Learning for Cross-Modal Retrieval0
EviNets: Neural Networks for Combining Evidence Signals for Factoid Question Answering0
Apples to Apples: Learning Semantics of Common Entities Through a Novel Comprehension Task0
Semantic Word Clusters Using Signed Spectral Clustering0
Improving Semantic Relevance for Sequence-to-Sequence Learning of Chinese Social Media Text SummarizationCode0
Synergistic Union of Word2Vec and Lexicon for Domain Specific Semantic Similarity0
Simbow : une mesure de similarit\'e s\'emantique entre textes (Simbow : a semantic similarity metric between texts)0
Am\'elioration de la similarit\'e s\'emantique vectorielle par m\'ethodes non-supervis\'ees (Improved the Semantic Similarity with Weighting Vectors)0
Cr\'eation et validation de signatures s\'emantiques : application \`a la mesure de similarit\'e s\'emantique et \`a la substitution lexicale (Creating and validating semantic signatures : application for measuring semantic similarity and lexical substitution)0
Semantic Specialisation of Distributional Word Vector Spaces using Monolingual and Cross-Lingual ConstraintsCode0
Semi-supervised Learning with GANs: Manifold Invariance with Improved Inference0
Relevance-based Word Embedding0
Supervised Learning of Universal Sentence Representations from Natural Language Inference DataCode1
Cross-lingual Learning of Semantic Textual Similarity with Multilingual Word Representations0
Finnish resources for evaluating language model semanticsCode0
Word vectors, reuse, and replicability: Towards a community repository of large-text resources0
Automatic Morpheme Segmentation and Labeling in Universal Dependencies ResourcesCode0
Representing Sentences as Low-Rank Subspaces0
Semantic Similarity from Natural Language and Ontology Analysis0
Cross-media Similarity Metric Learning with Unified Deep Networks0
Exploring Word Embeddings for Unsupervised Textual User-Generated Content Normalization0
CompiLIG at SemEval-2017 Task 1: Cross-Language Plagiarism Detection Methods for Semantic Textual SimilarityCode0
Interpretation of Semantic Tweet RepresentationsCode0
Word Vector Space Specialisation0
Understanding Idiomatic Variation0
Improving Verb Metaphor Detection by Propagating Abstractness to Words, Phrases and Individual Senses0
IIT (BHU): System Description for LSDSem'17 Shared Task0
Word Similarity Datasets for Indian Languages: Annotation and Baseline Systems0
Semantic Similarity of Arabic Sentences with Word Embeddings0
Word Sense Filtering Improves Embedding-Based Lexical Substitution0
Complex Verbs are Different: Exploring the Visual Modality in Multi-Modal Models to Predict Compositionality0
Literal or idiomatic? Identifying the reading of single occurrences of German multiword expressions using word embeddings0
Cross-Lingual Syntactically Informed Distributed Word Representations0
Show:102550
← PrevPage 35 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified