SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 701–725 of 2381 papers

TitleStatusHype
Ebiquity: Paraphrase and Semantic Similarity in Twitter using Skipgrams—0
BERTer: The Efficient One—0
ECNU at SemEval-2016 Task 1: Leveraging Word Embedding From Macro and Micro Views to Boost Performance for Semantic Textual Similarity—0
ECNU at SemEval-2016 Task 3: Exploring Traditional Method and Deep Learning Method for Question Retrieval and Answer Ranking in Community Question Answering—0
ECNU at SemEval-2017 Task 1: Leverage Kernel-based Traditional NLP features and Neural Networks to Build a Universal Model for Multilingual and Cross-lingual Semantic Textual Similarity—0
ECNU at SemEval-2017 Task 3: Using Traditional and Deep Learning Methods to Address Community Question Answering Task—0
ECNU at SemEval-2017 Task 7: Using Supervised and Unsupervised Methods to Detect and Locate English Puns—0
ECNU at SemEval-2018 Task 10: Evaluating Simple but Effective Features on Machine Learning Methods for Semantic Difference Detection—0
ECNUCS: Measuring Short Text Semantic Equivalence Using Multiple Similarity Measurements—0
ECNUCS: Recognizing Cross-lingual Textual Entailment Using Multiple Text Similarity and Text Difference Measures—0
ECNU: Leveraging on Ensemble of Heterogeneous Features and Information Enrichment for Cross Level Semantic Similarity Estimation—0
ECNU: Leveraging Word Embeddings to Boost Performance for Paraphrase in Twitter—0
ECNU: One Stone Two Birds: Ensemble of Heterogenous Measures for Semantic Relatedness and Textual Entailment—0
ECNU: Using Multiple Sources of CQA-based Information for Answers Selection and YES/NO Response Inference—0
ECNU: Using Traditional Similarity Measurements and Word Embedding for Semantic Textual Similarity Estimation—0
EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association—0
EDS-MEMBED: Multi-sense embeddings based on enhanced distributional semantic structures via a graph walk over word senses—0
Early Discovery of Emerging Entities in Persian Twitter with Semantic Similarity—0
Effective Parallel Corpus Mining using Bilingual Sentence Embeddings—0
Effective Transfer Learning for Identifying Similar Questions: Matching User Questions to COVID-19 FAQs—0
Effects of Creativity and Cluster Tightness on Short Text Clustering Performance—0
Efficient Audio Captioning Transformer with Patchout and Text Guidance—0
Efficient comparison of sentence embeddings—0
Efficient data selection employing Semantic Similarity-based Graph Structures for model training—0
A Framework for the Construction of Monolingual and Cross-lingual Word Similarity Datasets—0
Show:102550
← PrevPage 29 of 96Next →
All datasetsSTS BenchmarkMTEBMRPCSICKSTS13STS14STS12STS15STS16MRPC DevSentEvalSICK-R

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8—Unverified
2DeBERTa (large)Accuracy92.5—Unverified
3SMART-BERTDev Pearson Correlation90—Unverified
4MT-DNN-SMARTPearson Correlation0.93—Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93—Unverified
6Mnet-SimPearson Correlation0.93—Unverified
7XLNet (single model)Pearson Correlation0.93—Unverified
8T5-11BPearson Correlation0.93—Unverified
9ALBERTPearson Correlation0.93—Unverified
10RoBERTaPearson Correlation0.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54—Unverified
2ST5-XXLSpearman Correlation82.63—Unverified
3ST5-LargeSpearman Correlation81.83—Unverified
4ST5-XLSpearman Correlation81.66—Unverified
5ST5-BaseSpearman Correlation81.14—Unverified
6MPNet-multilingualSpearman Correlation80.73—Unverified
7SGPT-5.8B-nliSpearman Correlation80.53—Unverified
8MPNetSpearman Correlation80.28—Unverified
9MiniLM-L12Spearman Correlation79.8—Unverified
10SimCSE-BERT-supSpearman Correlation79.12—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7—Unverified
2ALBERTAccuracy93.4—Unverified
3RoBERTa (ensemble)Accuracy92.3—Unverified
4BigBirdF191.5—Unverified
5StructBERTRoBERTa ensembleAccuracy91.5—Unverified
6FLOATER-largeAccuracy91.4—Unverified
7SMARTAccuracy91.3—Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91—Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191—Unverified
10SpanBERTAccuracy90.9—Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82—Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82—Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82—Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81—Unverified
6SentenceBERTSpearman Correlation0.75—Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74—Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74—Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74—Unverified
10SBERT-NLI-largeSpearman Correlation0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91—Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91—Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9—Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9—Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89—Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89—Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88—Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88—Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87—Unverified