SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 701750 of 2381 papers

TitleStatusHype
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the QuestionCode1
Unsupervised Text Summarization of Long Documents using Dependency-based Noun Phrases and Contextual Order Arrangement0
Sentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentation0
Zero-Shot Text Matching for Automated Auditing using Sentence Transformers0
You can't pick your neighbors, or can you? When and how to rely on retrieval in the kNN-LMCode0
SSD: Towards Better Text-Image Consistency Metric in Text-to-Image GenerationCode0
Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model0
Improving Adversarial Robustness with Self-Paced Hard-Class Pair ReweightingCode0
A practical method for occupational skills detection in Vietnamese job listings0
Pointly-Supervised Panoptic SegmentationCode1
Subspace Representations for Soft Set Operations and Sentence SimilaritiesCode1
Describing Sets of Images with Textual-PCACode1
Multi-view Semantic Matching of Question retrieval using Fine-grained Semantic Representations0
AugCSE: Contrastive Sentence Embedding with Diverse AugmentationsCode1
Retrofitting Multilingual Sentence Embeddings with Abstract Meaning RepresentationCode0
Hardness of Samples Need to be Quantified for a Reliable Evaluation System: Exploring Potential Opportunities with a New Task0
MTEB: Massive Text Embedding BenchmarkCode4
Like a bilingual baby: The advantage of visually grounding a bilingual language model0
SDA: Simple Discrete Augmentation for Contrastive Sentence Representation LearningCode0
Learning to embed semantic similarity for joint image-text retrieval0
GMA3D: Local-Global Attention Learning to Estimate Occluded Motions of Scene FlowCode0
Reinforcement Learning with Large Action Spaces for Neural Machine Translation0
Measuring Fine-Grained Semantic Equivalence with Abstract Meaning Representation0
Weak-shot Semantic Segmentation via Dual Similarity TransferCode1
A Framework for Web Services Retrieval Using Bio Inspired Clustering0
ContraCLM: Contrastive Learning For Causal Language ModelCode1
Lexical semantics enhanced neural word embeddings0
SNLP at TextGraphs 2022 Shared Task: Unsupervised Natural Language Premise Selection in Mathematical Texts Using Sentence-MPNet0
Varanalysis@SV-Ident 2022: Variable Detection and Disambiguation Based on Semantic Similarity0
TextGraphs-16 Natural Language Premise Selection Task: Zero-Shot Premise Selection with Prompting Generative Language Models0
OpticE: A Coherence Theory-Based Model for Link Prediction0
Speaker Clustering in Textual Dialogue with Pairwise Utterance Relation and Cross-corpus Dialogue Act Supervision0
CitRet: A Hybrid Model for Cited Text Span RetrievalCode0
QSTS: A Question-Sensitive Text Similarity Measure for Question Generation0
Don’t Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention PoolingCode0
A Generalized Method for Automated Multilingual Loanword DetectionCode0
KEViN: A Knowledge Enhanced Validity and Novelty Classifier for Arguments0
COPNER: Contrastive Learning with Prompt Guiding for Few-shot Named Entity RecognitionCode1
ConIsI: A Contrastive Framework with Inter-sentence Interaction for Self-supervised Sentence Representation0
Evaluation of taxonomic and neural embedding methods for calculating semantic similarity0
Word to Sentence Visual Semantic Similarity for Caption Generation: Lessons Learned0
SAPA: Similarity-Aware Point Affiliation for Feature UpsamplingCode1
Raising the Bar on the Evaluation of Out-of-Distribution Detection0
Unsupervised Hashing with Semantic Concept MiningCode0
An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings LearningCode0
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation MetricsCode0
Non-Linguistic Supervision for Contrastive Learning of Sentence EmbeddingsCode1
A Closer Look at Novel Class Discovery from the Labeled Set0
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity MatchingCode0
Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention PoolingCode0
Show:102550
← PrevPage 15 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified