SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 1501–1525 of 2381 papers

TitleStatusHype
THU\_NGN at SemEval-2018 Task 10: Capturing Discriminative Attributes with MLP-CNN model—0
Tiantianzhu7:System Description of Semantic Textual Similarity (STS) in the SemEval-2012 (Task 6)—0
Time-Aware Evidence Ranking for Fact-Checking—0
'Tis but Thy Name: Semantic Question Answering Evaluation with 11M Names for 1M Entities—0
TKLBLIIR: Detecting Twitter Paraphrases with TweetingJay—0
Tmuse: Lexical Network Exploration—0
Together we stand: Siamese Networks for Similar Question Retrieval—0
Token-Level Privacy in Large Language Models—0
Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs—0
Top a Splitter: Using Distributional Semantics for Improving Compound Splitting—0
Topical Key Concept Extraction from Folksonomy—0
TopoLedgerBERT: Topological Learning of Ledger Description Embeddings using Siamese BERT-Networks—0
Toward a Computational Multidimensional Lexical Similarity Measure for Modeling Word Association Tasks in Psycholinguistics—0
Toward a Realistic Benchmark for Out-of-Distribution Detection—0
Towards Actual (Not Operational) Textual Style Transfer Auto-Evaluation—0
Towards a Gold Standard Corpus for Variable Detection and Linking in Social Science Publications—0
Towards a Gold Standard for Evaluating Danish Word Embeddings—0
Towards a Structured Representation of Generic Concepts and Relations in Large Text Corpora—0
Towards Automated Patent Workflows: AI-Orchestrated Multi-Agent Framework for Intellectual Property Management and Analysis—0
Towards Automatic Thesaurus Construction and Enrichment.—0
Towards Compositional Tree Kernels—0
Towards Dynamic Word Sense Discrimination with Random Indexing—0
Towards explainable evaluation of language models on the semantic similarity of visual concepts—0
Towards Label-Only Membership Inference Attack against Pre-trained Large Language Models—0
Towards Semantic Communications: Deep Learning-Based Image Semantic Coding—0
Show:102550
← PrevPage 61 of 96Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8—Unverified
2DeBERTa (large)Accuracy92.5—Unverified
3SMART-BERTDev Pearson Correlation90—Unverified
4MT-DNN-SMARTPearson Correlation0.93—Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93—Unverified
6Mnet-SimPearson Correlation0.93—Unverified
7XLNet (single model)Pearson Correlation0.93—Unverified
8T5-11BPearson Correlation0.93—Unverified
9ALBERTPearson Correlation0.93—Unverified
10RoBERTaPearson Correlation0.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54—Unverified
2ST5-XXLSpearman Correlation82.63—Unverified
3ST5-LargeSpearman Correlation81.83—Unverified
4ST5-XLSpearman Correlation81.66—Unverified
5ST5-BaseSpearman Correlation81.14—Unverified
6MPNet-multilingualSpearman Correlation80.73—Unverified
7SGPT-5.8B-nliSpearman Correlation80.53—Unverified
8MPNetSpearman Correlation80.28—Unverified
9MiniLM-L12Spearman Correlation79.8—Unverified
10SimCSE-BERT-supSpearman Correlation79.12—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7—Unverified
2ALBERTAccuracy93.4—Unverified
3RoBERTa (ensemble)Accuracy92.3—Unverified
4BigBirdF191.5—Unverified
5StructBERTRoBERTa ensembleAccuracy91.5—Unverified
6FLOATER-largeAccuracy91.4—Unverified
7SMARTAccuracy91.3—Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91—Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191—Unverified
10SpanBERTAccuracy90.9—Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82—Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82—Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82—Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81—Unverified
6SentenceBERTSpearman Correlation0.75—Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74—Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74—Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74—Unverified
10SBERT-NLI-largeSpearman Correlation0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91—Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91—Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9—Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9—Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89—Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89—Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88—Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88—Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87—Unverified