SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 23012350 of 2381 papers

TitleStatusHype
UdL at SemEval-2017 Task 1: Semantic Textual Similarity Estimation of English Sentence Pairs Using Regression Model over Pairwise FeaturesCode0
Towards Flexible Evaluation for Generative Visual Question AnsweringCode0
Semantic Structure-based Unsupervised Deep HashingCode0
LyricSIM: A novel Dataset and Benchmark for Similarity Detection in Spanish Song LyricSCode0
SemSup: Semantic Supervision for Simple and Scalable Zero-shot GeneralizationCode0
Machine Translation Evaluation using Recurrent Neural NetworksCode0
Prototypical Contrast and Reverse Prediction: Unsupervised Skeleton Based Action RecognitionCode0
Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language ModelsCode0
COPER: a Query-adaptable Semantics-based Search Engine for Persian COVID-19 ArticlesCode0
VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene GraphCode0
Making Fast Graph-based Algorithms with Graph Metric EmbeddingsCode0
Semantic Textual Similarity Assessment in Chest X-ray Reports Using a Domain-Specific Cosine-Based MetricCode0
Controlling Length in Abstractive Summarization Using a Convolutional Neural NetworkCode0
TLAC: Two-stage LMM Augmented CLIP for Zero-Shot ClassificationCode0
A Common Semantic Space for Monolingual and Cross-Lingual Meta-EmbeddingsCode0
Toeing the Party Line: Election Manifestos as a Key to Understand Political Discourse on TwitterCode0
Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual InformationCode0
Eval-GCSC: A New Metric for Evaluating ChatGPT's Performance in Chinese Spelling CorrectionCode0
A Collection of Pragmatic-Similarity Judgments over Spoken Dialog UtterancesCode0
ETPC - A Paraphrase Identification Corpus Annotated with Extended Paraphrase Typology and NegationCode0
MathLingBudapest: Concept Networks for Semantic SimilarityCode0
Phrase Localization Without Paired Training ExamplesCode0
SemanticZ at SemEval-2016 Task 3: Ranking Relevant Answers in Community Question Answering Using Semantic Similarity Based on Fine-tuned Word EmbeddingsCode0
Quantifying Positional Biases in Text Embedding ModelsCode0
UMBCLU at SemEval-2024 Task 1A and 1C: Semantic Textual Relatedness with and without machine translationCode0
Estimating Semantic Similarity between In-Domain and Out-of-Domain SamplesCode0
ERNIE: Enhanced Language Representation with Informative EntitiesCode0
A Joint Sequence Fusion Model for Video Question Answering and RetrievalCode0
Sematch: Semantic Entity Search from Knowledge GraphCode0
Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time SteeringCode0
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword RegularizationCode0
Informative and Representative Triplet Selection for Multilabel Remote Sensing Image RetrievalCode0
RAmBLA: A Framework for Evaluating the Reliability of LLMs as Assistants in the Biomedical DomainCode0
A Novel Patent Similarity Measurement Methodology: Semantic Distance and Technological DistanceCode0
Accidental Misalignment: Fine-Tuning Language Models Induces Unexpected VulnerabilityCode0
Webly Supervised Image Classification with Metadata: Automatic Noisy Label Correction via Visual-Semantic GraphCode0
Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact VerificationCode0
Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence EmbeddingCode0
Measuring Semantic Similarity of Words Using Concept NetworksCode0
Contrastive Learning in Distilled ModelsCode0
Ranked List Loss for Deep Metric LearningCode0
Ranking and Classification driven Feature Learning for Person Re_identificationCode0
EquivPruner: Boosting Efficiency and Quality in LLM-Based Search via Action PruningCode0
Continual Learning for Sentence Representations Using ConceptorsCode0
SUNNYNLP at SemEval-2018 Task 10: A Support-Vector-Machine-Based Method for Detecting Semantic Difference using Taxonomy and Word Embedding FeaturesCode0
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression GroundingCode0
Continual Audio-Visual Sound SeparationCode0
Textual analysis of artificial intelligence manuscripts reveals features associated with peer review outcomeCode0
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative SamplingCode0
ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched EmbeddingsCode0
Show:102550
← PrevPage 47 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified