SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 351–400 of 2381 papers

TitleStatusHype
Prompt-tuning for Clickbait Detection via Text Summarization—0
Image Generative Semantic Communication with Multi-Modal Similarity Estimation for Resource-Limited Networks—0
Exploring Key Point Analysis with Pairwise Generation and Graph PartitioningCode0
Toward a Realistic Benchmark for Out-of-Distribution Detection—0
Calibrating Higher-Order Statistics for Few-Shot Class-Incremental Learning with Pre-trained Vision TransformersCode1
Know When To Stop: A Study of Semantic Drift in Text Generation—0
Semantic Stealth: Adversarial Text Attacks on NLP Using Several Methods—0
Retrieval-Augmented Open-Vocabulary Object DetectionCode1
SLPL SHROOM at SemEval2024 Task 06: A comprehensive study on models ability to detect hallucinationCode0
Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approach—0
ALOHa: A New Measure for Hallucination in Captioning Models—0
Rematch: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic SimilarityCode0
Weakly-supervised Audio Separation via Bi-modal Semantic SimilarityCode2
ParaICL: Towards Parallel In-Context LearningCode0
SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian LanguagesCode1
Attention-aware semantic relevance predicting Chinese sentence reading—0
DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment—0
Evaluation of Semantic Search and its Role in Retrieved-Augmented-Generation (RAG) for Arabic Language—0
Lightweight Embeddings for Graph Collaborative FilteringCode0
KDMCSE: Knowledge Distillation Multimodal Sentence Embeddings with Adaptive Angular margin Contrastive LearningCode1
Temporal and Semantic Evaluation Metrics for Foundation Models in Post-Hoc Analysis of Robotic Sub-tasksCode0
ESREAL: Exploiting Semantic Reconstruction to Mitigate Hallucinations in Vision-Language Models—0
Connecting the Dots: Inferring Patent Phrase Similarity with Retrieved Phrase Graphs—0
A Collection of Pragmatic-Similarity Judgments over Spoken Dialog UtterancesCode0
Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narratives—0
RAmBLA: A Framework for Evaluating the Reliability of LLMs as Assistants in the Biomedical DomainCode0
A Modified Word Saliency-Based Adversarial Attack on Text Classification Models—0
RobustSentEmbed: Robust Sentence Embeddings Using Adversarial Self-Supervised Contrastive LearningCode0
NLP Verification: Towards a General Methodology for Certifying RobustnessCode0
SIFiD: Reassess Summary Factual Inconsistency Detection with LLM—0
Knowledge-aware Alert Aggregation in Large-scale Cloud Systems: a Hybrid Approach—0
Deep Contrastive Multi-view Clustering under Semantic Feature Guidance—0
Is Cosine-Similarity of Embeddings Really About Similarity?—0
Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similarity—0
Learning to Rematch Mismatched Pairs for Robust Cross-Modal RetrievalCode1
SAM-PD: How Far Can SAM Take Us in Tracking and Segmenting Anything in Videos by Prompt DenoisingCode0
Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation—0
GPTSee: Enhancing Moment Retrieval and Highlight Detection via Description-Based Similarity Features—0
Improving Cross-lingual Representation for Semantic Retrieval with Code-switching—0
EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic SegmentationCode2
API Is Enough: Conformal Prediction for Large Language Models Without Logit-Access—0
Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off—0
PaECTER: Patent-level Representation Learning using Citation-informed Transformers—0
Towards Better Understanding of Contrastive Sentence Representation Learning: A Unified Paradigm for GradientCode0
Meta-Task Prompting Elicits Embeddings from Large Language ModelsCode1
Investigating Continual Pretraining in Large Language Models: Insights and Implications—0
NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long DocumentsCode1
BiVRec: Bidirectional View-based Multimodal Sequential Recommendation—0
Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings—0
Sequential Visual and Semantic Consistency for Semi-supervised Text Recognition—0
Show:102550
← PrevPage 8 of 48Next →
All datasetsSTS BenchmarkMTEBMRPCSICKSTS13STS14STS12STS15STS16MRPC DevSentEvalSICK-R

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8—Unverified
2DeBERTa (large)Accuracy92.5—Unverified
3SMART-BERTDev Pearson Correlation90—Unverified
4MT-DNN-SMARTPearson Correlation0.93—Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93—Unverified
6Mnet-SimPearson Correlation0.93—Unverified
7XLNet (single model)Pearson Correlation0.93—Unverified
8T5-11BPearson Correlation0.93—Unverified
9ALBERTPearson Correlation0.93—Unverified
10RoBERTaPearson Correlation0.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54—Unverified
2ST5-XXLSpearman Correlation82.63—Unverified
3ST5-LargeSpearman Correlation81.83—Unverified
4ST5-XLSpearman Correlation81.66—Unverified
5ST5-BaseSpearman Correlation81.14—Unverified
6MPNet-multilingualSpearman Correlation80.73—Unverified
7SGPT-5.8B-nliSpearman Correlation80.53—Unverified
8MPNetSpearman Correlation80.28—Unverified
9MiniLM-L12Spearman Correlation79.8—Unverified
10SimCSE-BERT-supSpearman Correlation79.12—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7—Unverified
2ALBERTAccuracy93.4—Unverified
3RoBERTa (ensemble)Accuracy92.3—Unverified
4BigBirdF191.5—Unverified
5StructBERTRoBERTa ensembleAccuracy91.5—Unverified
6FLOATER-largeAccuracy91.4—Unverified
7SMARTAccuracy91.3—Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91—Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191—Unverified
10SpanBERTAccuracy90.9—Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82—Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82—Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82—Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81—Unverified
6SentenceBERTSpearman Correlation0.75—Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74—Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74—Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74—Unverified
10SBERT-NLI-largeSpearman Correlation0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91—Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91—Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9—Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9—Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89—Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89—Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88—Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88—Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87—Unverified