SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 2381 papers

TitleStatusHype
Everyone deserves their voice to be heard: Analyzing Predictive Gender Bias in ASR Models Applied to Dutch Speech Data—0
Squeezed Attention: Accelerating Long Context Length LLM InferenceCode2
Securing from Unseen: Connected Pattern Kernels (CoPaK) for Zero-Day Intrusion Detection—0
Leveraging LLMs to Enable Natural Language Search on Go-to-market Platforms—0
Semantic-Aware Resource Management for C-V2X Platooning via Multi-Agent Reinforcement LearningCode1
GASE: Generatively Augmented Sentence Encoding—0
RAGulator: Lightweight Out-of-Context Detectors for Grounded Text Generation—0
Fine-Grained Guidance for Retrievers: Leveraging LLMs' Feedback in Retrieval-Augmented Generation—0
A Comparative Study of Recent Large Language Models on Generating Hospital Discharge Summaries for Lung Cancer Patients—0
Continual Audio-Visual Sound SeparationCode0
HACD: Harnessing Attribute Semantics and Mesoscopic Structure for Community DetectionCode0
CmdCaliper: A Semantic-Aware Command-Line Embedding Model and Dataset for Security ResearchCode1
NLP and Education: using semantic similarity to evaluate filled gaps in a large-scale Cloze test in the classroom—0
FedDTPT: Federated Discrete and Transferable Prompt Tuning for Black-Box Large Language Models—0
EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection—0
Phonology-Guided Speech-to-Speech Translation for African Languages—0
Emotional RAG: Enhancing Role-Playing Agents through Emotional RetrievalCode1
BIS: NL2SQL Service Evaluation Benchmark for Business Intelligence ScenariosCode0
Decoupling Semantic Similarity from Spatial Alignment for Neural NetworksCode0
Conjuring Semantic Similarity—0
Toeing the Party Line: Election Manifestos as a Key to Understand Political Discourse on TwitterCode0
Improving General Text Embedding Model: Tackling Task Conflict and Data Imbalance through Model Merging—0
Optimizing Retrieval-Augmented Generation with Elasticsearch for Enhanced Question-Answering Systems—0
Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt Model—0
Automatically Interpreting Millions of Features in Large Language ModelsCode3
Boosting Imperceptibility of Stable Diffusion-based Adversarial Examples Generation with MomentumCode0
SemSim: Revisiting Weak-to-Strong Consistency from a Semantic Similarity Perspective for Semi-supervised Medical Image Segmentation—0
PromptExp: Multi-granularity Prompt Explanation of Large Language Models—0
Back-of-the-Book Index Automation for Arabic Documents—0
Improving Legal Entity Recognition Using a Hybrid Transformer Model and Semantic Filtering Approach—0
Large Continual Instruction AssistantCode2
VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks—0
Graded Suspiciousness of Adversarial Texts to Human—0
Metadata-based Data Exploration with Retrieval-Augmented Generation for Large Language Models—0
Evaluating Deduplication Techniques for Economic Research Paper Titles with a Focus on Semantic Similarity using NLP and LLMs—0
UniAdapt: A Universal Adapter for Knowledge Calibration—0
Semantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithms—0
From Unimodal to Multimodal: Scaling up Projectors to Align ModalitiesCode0
T3: A Novel Zero-shot Transfer Learning Framework Iteratively Training on an Assistant Task for a Target Task—0
Exploring Semantic Clustering in Deep Reinforcement Learning for Video Games—0
Unveiling Ontological Commitment in Multi-Modal Foundation Models—0
Mitigating Semantic Leakage in Cross-lingual Embeddings via Orthogonality ConstraintCode0
Brotherhood at WMT 2024: Leveraging LLM-Generated Contextual Conversations for Cross-Lingual Image Captioning—0
Learning to Localize Actions in Instructional Videos with LLM-Based Multi-Pathway Text-Video Alignment—0
Towards Automated Patent Workflows: AI-Orchestrated Multi-Agent Framework for Intellectual Property Management and Analysis—0
Towards Building Efficient Sentence BERT Models using Layer Pruning—0
Demystifying and Extracting Fault-indicating Information from Logs for Failure DiagnosisCode1
Enhancing Unsupervised Sentence Embeddings via Knowledge-Driven Data Augmentation and Gaussian-Decayed Contrastive Learning—0
Linguistic Minimal Pairs Elicit Linguistic Similarity in Large Language ModelsCode2
Reasoning Graph Enhanced Exemplars Retrieval for In-Context LearningCode0
Show:102550
← PrevPage 5 of 48Next →
All datasetsSTS BenchmarkMTEBMRPCSICKSTS13STS14STS12STS15STS16MRPC DevSentEvalSICK-R

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8—Unverified
2DeBERTa (large)Accuracy92.5—Unverified
3SMART-BERTDev Pearson Correlation90—Unverified
4MT-DNN-SMARTPearson Correlation0.93—Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93—Unverified
6Mnet-SimPearson Correlation0.93—Unverified
7XLNet (single model)Pearson Correlation0.93—Unverified
8ALBERTPearson Correlation0.93—Unverified
9T5-11BPearson Correlation0.93—Unverified
10RoBERTaPearson Correlation0.92—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54—Unverified
2ST5-XXLSpearman Correlation82.63—Unverified
3ST5-LargeSpearman Correlation81.83—Unverified
4ST5-XLSpearman Correlation81.66—Unverified
5ST5-BaseSpearman Correlation81.14—Unverified
6MPNet-multilingualSpearman Correlation80.73—Unverified
7SGPT-5.8B-nliSpearman Correlation80.53—Unverified
8MPNetSpearman Correlation80.28—Unverified
9MiniLM-L12Spearman Correlation79.8—Unverified
10SimCSE-BERT-supSpearman Correlation79.12—Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7—Unverified
2ALBERTAccuracy93.4—Unverified
3RoBERTa (ensemble)Accuracy92.3—Unverified
4BigBirdF191.5—Unverified
5StructBERTRoBERTa ensembleAccuracy91.5—Unverified
6FLOATER-largeAccuracy91.4—Unverified
7SMARTAccuracy91.3—Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91—Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191—Unverified
10SpanBERTAccuracy90.9—Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82—Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82—Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82—Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81—Unverified
6SentenceBERTSpearman Correlation0.75—Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74—Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74—Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74—Unverified
10SBERT-NLI-largeSpearman Correlation0.74—Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91—Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91—Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9—Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9—Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9—Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89—Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89—Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88—Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88—Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87—Unverified