SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 551600 of 2381 papers

TitleStatusHype
Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue SystemsCode0
Anchor-Aware Similarity Cohesion in Target Frames Enables Predicting Temporal Moment Boundaries in 2DCode0
Generating More Interesting Responses in Neural Conversation Models with Distributional ConstraintsCode0
IISCNLP at SemEval-2016 Task 2: Interpretable STS with ILP based Multiple Chunk AlignerCode0
Integrating Visual and Semantic Similarity Using Hierarchies for Image RetrievalCode0
Finnish resources for evaluating language model semanticsCode0
FlowRetrieval: Flow-Guided Data Retrieval for Few-Shot Imitation LearningCode0
An Assessment of Experimental Protocols for Tracing Changes in Word Semantics Relative to Accuracy and ReliabilityCode0
Few-shot Hybrid Domain Adaptation of Image GeneratorsCode0
FFCI: A Framework for Interpretable Automatic Evaluation of SummarizationCode0
Datasets for Portuguese Legal Semantic Textual Similarity: Comparing weak supervision and an annotation process approachesCode0
Automatic Design of Semantic Similarity Ensembles Using Grammatical EvolutionCode0
FAT ALBERT: Finding Answers in Large Texts using Semantic Similarity Attention Layer based on BERTCode0
Fake News Detection After LLM Laundering: Measurement and ExplanationCode0
Advancing Semantic Textual Similarity Modeling: A Regression Framework with Translated ReLU and Smooth K2 LossCode0
FA: Forced Prompt Learning of Vision-Language Models for Out-of-Distribution DetectionCode0
FarFetched: Entity-centric Reasoning and Claim Validation for the Greek Language based on Textually Represented EnvironmentsCode0
Exploiting Twitter as Source of Large Corpora of Weakly Similar Pairs for Semantic Sentence EmbeddingsCode0
Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence SimilarityCode0
Explaining Text Similarity in Transformer ModelsCode0
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022Code0
Exploring Key Point Analysis with Pairwise Generation and Graph PartitioningCode0
Automatic Morpheme Segmentation and Labeling in Universal Dependencies ResourcesCode0
De-Conflated Semantic RepresentationsCode0
CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMsCode0
Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual InformationCode0
ETPC - A Paraphrase Identification Corpus Annotated with Extended Paraphrase Typology and NegationCode0
20min-XD: A Comparable Corpus of Swiss News ArticlesCode0
Estimating Semantic Similarity between In-Domain and Out-of-Domain SamplesCode0
Eval-GCSC: A New Metric for Evaluating ChatGPT's Performance in Chinese Spelling CorrectionCode0
Exploring RWKV for Sentence Embeddings: Layer-wise Analysis and Baseline Comparison for Semantic SimilarityCode0
EquivPruner: Boosting Efficiency and Quality in LLM-Based Search via Action PruningCode0
Supervised Online Hashing via Hadamard Codebook LearningCode0
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression GroundingCode0
GenSense: A Generalized Sense Retrofitting ModelCode0
Deep Metric Learning Beyond Binary SupervisionCode0
ERNIE: Enhanced Language Representation with Informative EntitiesCode0
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative SamplingCode0
Analyzing how BERT performs entity matchingCode0
Autoencoding Pixies: Amortised Variational Inference with Graph Convolutions for Functional Distributional SemanticsCode0
Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal ReasoningCode0
GSTran: Joint Geometric and Semantic Coherence for Point Cloud SegmentationCode0
EL Embeddings: Geometric construction of models for the Description Logic EL ++Code0
Efficient Heuristics Generation for Solving Combinatorial Optimization Problems Using Large Language ModelsCode0
Auto-Encoding Dictionary Definitions into Consistent Word EmbeddingsCode0
EMBEDDIA at SemEval-2022 Task 8: Investigating Sentence, Image, and Knowledge Graph Representations for Multilingual News Article SimilarityCode0
Cross-Lingual Cross-Platform Rumor Verification Pivoting on Multimedia ContentCode0
TinyBERT: Distilling BERT for Natural Language UnderstandingCode0
HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on TextCode0
Embeddings Evaluation Using a Novel Measure of Semantic SimilarityCode0
Show:102550
← PrevPage 12 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified