SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2251–2300 of 2381 papers

TitleStatusHype
What metaphor identification systems can tell us about metaphor-in-language—0
CPN-CORE: A Text Semantic Similarity System Infused with Opinion Knowledge—0
SOFTCARDINALITY: Hierarchical Text Overlap for Student Response Analysis—0
SOFTCARDINALITY-CORE: Improving Text Overlap with Distributional Measures for Semantic Textual Similarity—0
MayoClinicNLP--CORE: Semantic representations for textual similarity—0
CFILT-CORE: Semantic Textual Similarity using Universal Networking Language—0
UNITOR-CORE\_TYPED: Combining Text Similarity and Semantic Filters through SV Regression—0
UNIBA-CORE: Combining Strategies for Semantic Textual Similarity—0
UMCC\_DLSI: Textual Similarity based on Lexical-Semantic features—0
UMBC\_EBIQUITY-CORE: Semantic Textual Similarity Systems—0
ECNUCS: Recognizing Cross-lingual Textual Entailment Using Multiple Text Similarity and Text Difference Measures—0
UKP-BIU: Similarity and Entailment Metrics for Student Response Analysis—0
UCAM-CORE: Incorporating structured distributional similarity into STS—0
LIMSIILES: Basic English Substitution for Student Answer Assessment at SemEval 2013—0
HENRY-CORE: Domain Adaptation and Stacking for Text Similarity—0
UniMelb\_NLP-CORE: Integrating predictions from multiple domains and feature sets for estimating semantic textual similarity—0
MELODI: Semantic Similarity of Words and Compositional Phrases using Latent Vector Weighting—0
HsH: Estimating Semantic Similarity of Words and Short Phrases with Frequency Normalized Distance Measures—0
DeepPurple: Lexical, String and Affective Feature Fusion for Sentence-Level Semantic Similarity Estimation—0
IBM\_EG-CORE: Comparing multiple Lexical and NE matching features in measuring Semantic Textual similarity—0
Montague Meets Markov: Deep Semantics with Probabilistic Logical Form—0
UPC-CORE: What Can Machine Translation Evaluation Metrics and Wikipedia Do for Estimating Semantic Textual Similarity?—0
SXUCFN-Core: STS Models Integrating FrameNet Parsing Information—0
IIRG: A Naive Approach to Evaluating Phrasal Semantics—0
iKernels-Core: Tree Kernel Learning for Textual Similarity—0
DLS@CU-CORE: A Simple Machine Learning Model of Semantic Textual Similarity—0
SRIUBC-Core: Multiword Soft Similarity Models for Textual Similarity—0
NTNU-CORE: Combining strong features for semantic similarity—0
ETS: Domain Adaptation and Stacking for Short Answer Scoring—0
PolyUCOMP-CORE\_TYPED: Computing Semantic Textual Similarity using Overlapped Senses—0
INAOE\_UPV-CORE: Extracting Word Associations from Document Corpora to estimate Semantic Textual Similarity—0
GETALP System : Propagation of a Lesk Measure through an Ant Colony Algorithm—0
SemEval-2013 Task 5: Evaluating Phrasal Semantics—0
LIPN-CORE: Semantic Text Similarity using n-grams, WordNet, Syntactic Analysis, ESA and Information Retrieval based Features—0
CNGL: Grading Student Answers by Acts of Translation—0
*SEM 2013 shared task: Semantic Textual Similarity—0
Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 1: Proceedings of the Main Conference and the Shared Task: Semantic Textual Similarity—0
CNGL-CORE: Referential Translation Machines for Measuring Semantic Similarity—0
EHU-ALM: Similarity-Feature Based Approach for Student Response Analysis—0
KnCe2013-CORE:Semantic Text Similarity by use of Knowledge Bases—0
KLUE-CORE: A regression model of semantic textual similarity—0
ECNUCS: Measuring Short Text Semantic Equivalence Using Multiple Similarity Measurements—0
BUT-TYPED: Using domain knowledge for computing typed similarity—0
CLaC-CORE: Exhaustive Feature Combination for Measuring Textual Similarity—0
UMLS::Similarity: Measuring the Relatedness and Similarity of Biomedical Concepts—0
Same Referent, Different Words: Unsupervised Mining of Opaque Coreferent Mentions—0
Measuring Term Informativeness in Context—0
Ontology Label Translation—0
Cross-Lingual Semantic Similarity of Words as the Similarity of Their Semantic Word Responses—0
Multi-Metric Optimization Using Ensemble Tuning—0
Show:102550
← PrevPage 46 of 48Next →
All datasetsSTS BenchmarkMTEBMRPCSICKSTS13STS14STS12STS15STS16MRPC DevSentEvalSICK-R

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8—Unverified
2DeBERTa (large)Accuracy92.5—Unverified
3SMART-BERTDev Pearson Correlation90—Unverified
4MT-DNN-SMARTPearson Correlation0.93—Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93—Unverified
6Mnet-SimPearson Correlation0.93—Unverified
7XLNet (single model)Pearson Correlation0.93—Unverified
8ALBERTPearson Correlation0.93—Unverified
9T5-11BPearson Correlation0.93—Unverified
10RoBERTaPearson Correlation0.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54—Unverified
2ST5-XXLSpearman Correlation82.63—Unverified
3ST5-LargeSpearman Correlation81.83—Unverified
4ST5-XLSpearman Correlation81.66—Unverified
5ST5-BaseSpearman Correlation81.14—Unverified
6MPNet-multilingualSpearman Correlation80.73—Unverified
7SGPT-5.8B-nliSpearman Correlation80.53—Unverified
8MPNetSpearman Correlation80.28—Unverified
9MiniLM-L12Spearman Correlation79.8—Unverified
10SimCSE-BERT-supSpearman Correlation79.12—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7—Unverified
2ALBERTAccuracy93.4—Unverified
3RoBERTa (ensemble)Accuracy92.3—Unverified
4BigBirdF191.5—Unverified
5StructBERTRoBERTa ensembleAccuracy91.5—Unverified
6FLOATER-largeAccuracy91.4—Unverified
7SMARTAccuracy91.3—Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91—Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191—Unverified
10SpanBERTAccuracy90.9—Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82—Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82—Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82—Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81—Unverified
6SentenceBERTSpearman Correlation0.75—Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74—Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74—Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74—Unverified
10SBERT-NLI-largeSpearman Correlation0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91—Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91—Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9—Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9—Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89—Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89—Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88—Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88—Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87—Unverified