SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 376–400 of 2381 papers

TitleStatusHype
Discovering Knowledge Deficiencies of Language Models on Massive Knowledge Base—0
A Quantitative Approach to Evaluating Open-Source EHR Systems for Indian Healthcare—0
HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagery—0
Ontology-based Semantic Similarity Measures for Clustering Medical Concepts in Drug SafetyCode0
BeLightRec: A lightweight recommender system enhanced with BERT—0
CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation—0
SeLIP: Similarity Enhanced Contrastive Language Image Pretraining for Multi-modal Head MRI—0
Unleashing the power of text for credit default prediction: Comparing human-written and generative AI-refined texts—0
Vision Transformer Based Semantic Communications for Next Generation Wireless Networks—0
CASE -- Condition-Aware Sentence Embeddings for Conditional Semantic Textual Similarity Measurement—0
KVShare: An LLM Service System with Efficient and Effective Multi-Tenant KV Cache Reuse—0
A General Close-loop Predictive Coding Framework for Auditory Working Memory—0
TLAC: Two-stage LMM Augmented CLIP for Zero-Shot ClassificationCode0
Measuring Similarity in Causal Graphs: A Framework for Semantic and Structural Analysis—0
Domain Adaptation for Japanese Sentence Embeddings with Contrastive Learning based on Synthetic Sentence GenerationCode0
PromptMap: An Alternative Interaction Style for AI-Based Image GenerationCode0
Asymmetric Visual Semantic Embedding Framework for Efficient Vision-Language AlignmentCode0
Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols—0
MIGA: Mutual Information-Guided Attack on Denoising Models for Semantic Manipulation—0
AuthorMist: Evading AI Text Detectors with Reinforcement Learning—0
SEED: Towards More Accurate Semantic Evaluation for Visual Brain Decoding—0
Improving RAG Retrieval via Propositional Content Extraction: a Speech Act Theory Approach—0
AutoTestForge: A Multidimensional Automated Testing Framework for Natural Language Processing Models—0
Token-Level Privacy in Large Language Models—0
SEOE: A Scalable and Reliable Semantic Evaluation Framework for Open Domain Event Detection—0
Show:102550
← PrevPage 16 of 96Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8—Unverified
2DeBERTa (large)Accuracy92.5—Unverified
3SMART-BERTDev Pearson Correlation90—Unverified
4MT-DNN-SMARTPearson Correlation0.93—Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93—Unverified
6Mnet-SimPearson Correlation0.93—Unverified
7XLNet (single model)Pearson Correlation0.93—Unverified
8ALBERTPearson Correlation0.93—Unverified
9T5-11BPearson Correlation0.93—Unverified
10RoBERTaPearson Correlation0.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54—Unverified
2ST5-XXLSpearman Correlation82.63—Unverified
3ST5-LargeSpearman Correlation81.83—Unverified
4ST5-XLSpearman Correlation81.66—Unverified
5ST5-BaseSpearman Correlation81.14—Unverified
6MPNet-multilingualSpearman Correlation80.73—Unverified
7SGPT-5.8B-nliSpearman Correlation80.53—Unverified
8MPNetSpearman Correlation80.28—Unverified
9MiniLM-L12Spearman Correlation79.8—Unverified
10SimCSE-BERT-supSpearman Correlation79.12—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7—Unverified
2ALBERTAccuracy93.4—Unverified
3RoBERTa (ensemble)Accuracy92.3—Unverified
4BigBirdF191.5—Unverified
5StructBERTRoBERTa ensembleAccuracy91.5—Unverified
6FLOATER-largeAccuracy91.4—Unverified
7SMARTAccuracy91.3—Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91—Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191—Unverified
10SpanBERTAccuracy90.9—Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82—Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82—Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82—Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81—Unverified
6SentenceBERTSpearman Correlation0.75—Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74—Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74—Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74—Unverified
10SBERT-NLI-largeSpearman Correlation0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91—Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91—Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9—Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9—Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89—Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89—Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88—Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88—Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87—Unverified