Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 751–775 of 2381 papers

Title	Date	Tasks	Status	Hype
Ranking-Enhanced Unsupervised Sentence Representation Learning	Sep 9, 2022	Contrastive LearningData Augmentation	CodeCode Available	1
SUPER-Rec: SUrrounding Position-Enhanced Representation for Recommendation	Sep 9, 2022	Collaborative FilteringMatrix Completion	—Unverified	0
Towards explainable evaluation of language models on the semantic similarity of visual concepts	Sep 8, 2022	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph	Sep 7, 2022	Relational ReasoningSemantic Similarity	CodeCode Available	0
Monolingual alignment of word senses and definitions in lexicographical resources	Sep 6, 2022	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples	Sep 5, 2022	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Selective Text Augmentation with Word Roles for Low-Resource Text Classification	Sep 4, 2022	ClassificationData Augmentation	CodeCode Available	0
Zero-shot Event Causality Identification with Question Answering	Sep 1, 2022	ArticlesEvent Causality Identification	—Unverified	0
Combining Structured and Unstructured Knowledge in an Interactive Search Dialogue System	Sep 1, 2022	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne	Aug 29, 2022	Evolutionary AlgorithmsSemantic Similarity	—Unverified	0
Addressing Token Uniformity in Transformers via Singular Value Transformation	Aug 24, 2022	Semantic Textual Similarity	CodeCode Available	0
Graph-Augmented Cyclic Learning Framework for Similarity Estimation of Medical Clinical Notes	Aug 19, 2022	DiagnosticLanguage Modeling	—Unverified	0
Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approach	Aug 17, 2022	reinforcement-learningReinforcement Learning (RL)	—Unverified	0
MENLI: Robust Evaluation Metrics from Natural Language Inference	Aug 15, 2022	Adversarial AttackAdversarial Robustness	CodeCode Available	1
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale	Aug 15, 2022	GPULanguage Modelling	CodeCode Available	5
Paraphrasing, textual entailment, and semantic similarity above word level	Aug 10, 2022	Natural Language InferenceParaphrase Identification	—Unverified	0
Compositional Evaluation on Japanese Textual Entailment and Similarity	Aug 9, 2022	Natural Language InferenceSemantic Textual Similarity	CodeCode Available	1
Using Sentence Embeddings and Semantic Similarity for Seeking Consensus when Assessing Trustworthy AI	Aug 9, 2022	Semantic SimilaritySemantic Textual Similarity	CodeCode Available	0
Towards Semantic Communications: Deep Learning-Based Image Semantic Coding	Aug 8, 2022	Deep LearningImage Reconstruction	—Unverified	0
Patents Phrase to Phrase Semantic Matching Dataset	Aug 1, 2022	Patent classificationSemantic Textual Similarity	—Unverified	0
Uncertainty-based Visual Question Answering: Estimating Semantic Inconsistency between Image and Knowledge Base	Jul 27, 2022	Question AnsweringSemantic Similarity	—Unverified	0
A Cognitive Study on Semantic Similarity Analysis of Large Corpora: A Transformer-based Approach	Jul 24, 2022	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
The Birth of Bias: A case study on the evolution of gender bias in an English language model	Jul 21, 2022	Language ModelingLanguage Modelling	CodeCode Available	0
Tackling Long-Tailed Category Distribution Under Domain Shifts	Jul 20, 2022	Domain GeneralizationMeta-Learning	CodeCode Available	1
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression Grounding	Jul 18, 2022	AttributeReferring Expression	CodeCode Available	0

Show:10 25 50

← PrevPage 31 of 96Next →

All datasets STS Benchmark MTEB MRPC SICK STS13 STS14 STS12 STS15 STS16 MRPC Dev SentEval SICK-R

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SMARTRoBERTa	Dev Pearson Correlation	92.8	—	Unverified
2	DeBERTa (large)	Accuracy	92.5	—	Unverified
3	SMART-BERT	Dev Pearson Correlation	90	—	Unverified
4	MT-DNN-SMART	Pearson Correlation	0.93	—	Unverified
5	StructBERTRoBERTa ensemble	Pearson Correlation	0.93	—	Unverified
6	Mnet-Sim	Pearson Correlation	0.93	—	Unverified
7	XLNet (single model)	Pearson Correlation	0.93	—	Unverified
8	T5-11B	Pearson Correlation	0.93	—	Unverified
9	ALBERT	Pearson Correlation	0.93	—	Unverified
10	RoBERTa	Pearson Correlation	0.92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-UAE	Spearman Correlation	84.54	—	Unverified
2	ST5-XXL	Spearman Correlation	82.63	—	Unverified
3	ST5-Large	Spearman Correlation	81.83	—	Unverified
4	ST5-XL	Spearman Correlation	81.66	—	Unverified
5	ST5-Base	Spearman Correlation	81.14	—	Unverified
6	MPNet-multilingual	Spearman Correlation	80.73	—	Unverified
7	SGPT-5.8B-nli	Spearman Correlation	80.53	—	Unverified
8	MPNet	Spearman Correlation	80.28	—	Unverified
9	MiniLM-L12	Spearman Correlation	79.8	—	Unverified
10	SimCSE-BERT-sup	Spearman Correlation	79.12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MT-DNN-SMART	Accuracy	93.7	—	Unverified
2	ALBERT	Accuracy	93.4	—	Unverified
3	RoBERTa (ensemble)	Accuracy	92.3	—	Unverified
4	BigBird	F1	91.5	—	Unverified
5	StructBERTRoBERTa ensemble	Accuracy	91.5	—	Unverified
6	FLOATER-large	Accuracy	91.4	—	Unverified
7	SMART	Accuracy	91.3	—	Unverified
8	RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)	Accuracy	91	—	Unverified
9	RoBERTa-large 355M + Entailment as Few-shot Learner	F1	91	—	Unverified
10	SpanBERT	Accuracy	90.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.82	—	Unverified
2	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.82	—	Unverified
3	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.82	—	Unverified
4	SimCSE-RoBERTalarge	Spearman Correlation	0.82	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.81	—	Unverified
6	SentenceBERT	Spearman Correlation	0.75	—	Unverified
7	SRoBERTa-NLI-base	Spearman Correlation	0.74	—	Unverified
8	SRoBERTa-NLI-large	Spearman Correlation	0.74	—	Unverified
9	Dino (STS/̄🦕)	Spearman Correlation	0.74	—	Unverified
10	SBERT-NLI-large	Spearman Correlation	0.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-LLaMA-7B	Spearman Correlation	0.91	—	Unverified
2	AnglE-LLaMA-7B-v2	Spearman Correlation	0.91	—	Unverified
3	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.9	—	Unverified
4	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.9	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.9	—	Unverified
6	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.89	—	Unverified
7	Trans-Encoder-BERT-large-bi (unsup.)	Spearman Correlation	0.89	—	Unverified
8	Trans-Encoder-BERT-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
9	Trans-Encoder-RoBERTa-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
10	SimCSE-RoBERTa-large	Spearman Correlation	0.87	—	Unverified