Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1751–1775 of 2381 papers

Title	Date	Tasks	Status	Hype
Bootstrapping Unsupervised Bilingual Lexicon Induction	Apr 1, 2017	Bilingual Lexicon InductionSemantic Textual Similarity	—Unverified	0
Applying Multi-Sense Embeddings for German Verbs to Determine Semantic Relatedness and to Detect Non-Literal Language	Apr 1, 2017	Semantic Textual SimilarityWord Embeddings	—Unverified	0
Distributed Document and Phrase Co-embeddings for Descriptive Clustering	Apr 1, 2017	ClusteringDescriptive	—Unverified	0
Improving ROUGE for Timeline Summarization	Apr 1, 2017	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Bilingual Lexicon Induction by Learning to Combine Word-Level and Character-Level Representations	Apr 1, 2017	Bilingual Lexicon InductionClassification	—Unverified	0
Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation	Apr 1, 2017	Information RetrievalRepresentation Learning	—Unverified	0
Large-scale evaluation of dependency-based DSMs: Are they worth the effort?	Apr 1, 2017	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Is this a Child, a Girl or a Car? Exploring the Contribution of Distributional Similarity to Learning Referential Word Meanings	Apr 1, 2017	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Building Lexical Vector Representations from Concept Definitions	Apr 1, 2017	Dependency ParsingMachine Translation	—Unverified	0
Bundle Optimization for Multi-aspect Embedding	Mar 29, 2017	Clusteringimage-classification	—Unverified	0
Cross-modal Deep Metric Learning with Multi-task Regularization	Mar 21, 2017	Cross-Modal RetrievalMetric Learning	—Unverified	0
No Fuss Distance Metric Learning using Proxies	Mar 21, 2017	Metric LearningSemantic Similarity	CodeCode Available	1
Neobility at SemEval-2017 Task 1: An Attention-based Sentence Similarity Model	Mar 16, 2017	Cross-Lingual Semantic Textual SimilaritySemantic Textual Similarity	—Unverified	0
Story Cloze Ending Selection Baselines and Data Examination	Mar 13, 2017	Cloze TestSemantic Similarity	—Unverified	0
A Study of Metrics of Distance and Correlation Between Ranked Lists for Compositionality Detection	Mar 10, 2017	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
A Novel Comprehensive Approach for Estimating Concept Semantic Similarity in WordNet	Mar 6, 2017	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
A Knowledge-Based Approach to Word Sense Disambiguation by distributional selection and semantic features	Feb 27, 2017	Combinatorial OptimizationInformation Retrieval	—Unverified	0
Multilingual Multi-modal Embeddings for Natural Language Processing	Feb 3, 2017	Machine TranslationNMT	—Unverified	0
Just an Update on PMING Distance for Web-based Semantic Similarity in Artificial Intelligence and Data Mining	Jan 9, 2017	Information RetrievalRetrieval	—Unverified	0
Dense Associative Memory is Robust to Adversarial Inputs	Jan 4, 2017	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
If Sentences Could See: Investigating Visual Information for Semantic Textual Similarity	Jan 1, 2017	Machine TranslationSemantic Textual Similarity	—Unverified	0
Learning to Compose Spatial Relations with Grounded Neural Language Models	Jan 1, 2017	Semantic Textual SimilarityWord Embeddings	—Unverified	0
Deep Learning of Binary and Gradient Judgements for Semantic Paraphrase	Jan 1, 2017	Deep LearningParaphrase Identification	—Unverified	0
Correcting Contradictions	Jan 1, 2017	Common Sense ReasoningNatural Language Inference	CodeCode Available	0
Semantic Specialization of Distributional Word Vector Spaces using Monolingual and Cross-Lingual Constraints	Jan 1, 2017	Dialogue State TrackingRepresentation Learning	—Unverified	0

Show:10 25 50

← PrevPage 71 of 96Next →

All datasets STS Benchmark MTEB MRPC SICK STS13 STS14 STS12 STS15 STS16 MRPC Dev SentEval SICK-R

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SMARTRoBERTa	Dev Pearson Correlation	92.8	—	Unverified
2	DeBERTa (large)	Accuracy	92.5	—	Unverified
3	SMART-BERT	Dev Pearson Correlation	90	—	Unverified
4	MT-DNN-SMART	Pearson Correlation	0.93	—	Unverified
5	StructBERTRoBERTa ensemble	Pearson Correlation	0.93	—	Unverified
6	Mnet-Sim	Pearson Correlation	0.93	—	Unverified
7	XLNet (single model)	Pearson Correlation	0.93	—	Unverified
8	ALBERT	Pearson Correlation	0.93	—	Unverified
9	T5-11B	Pearson Correlation	0.93	—	Unverified
10	RoBERTa	Pearson Correlation	0.92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-UAE	Spearman Correlation	84.54	—	Unverified
2	ST5-XXL	Spearman Correlation	82.63	—	Unverified
3	ST5-Large	Spearman Correlation	81.83	—	Unverified
4	ST5-XL	Spearman Correlation	81.66	—	Unverified
5	ST5-Base	Spearman Correlation	81.14	—	Unverified
6	MPNet-multilingual	Spearman Correlation	80.73	—	Unverified
7	SGPT-5.8B-nli	Spearman Correlation	80.53	—	Unverified
8	MPNet	Spearman Correlation	80.28	—	Unverified
9	MiniLM-L12	Spearman Correlation	79.8	—	Unverified
10	SimCSE-BERT-sup	Spearman Correlation	79.12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MT-DNN-SMART	Accuracy	93.7	—	Unverified
2	ALBERT	Accuracy	93.4	—	Unverified
3	RoBERTa (ensemble)	Accuracy	92.3	—	Unverified
4	BigBird	F1	91.5	—	Unverified
5	StructBERTRoBERTa ensemble	Accuracy	91.5	—	Unverified
6	FLOATER-large	Accuracy	91.4	—	Unverified
7	SMART	Accuracy	91.3	—	Unverified
8	RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)	Accuracy	91	—	Unverified
9	RoBERTa-large 355M + Entailment as Few-shot Learner	F1	91	—	Unverified
10	SpanBERT	Accuracy	90.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.82	—	Unverified
2	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.82	—	Unverified
3	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.82	—	Unverified
4	SimCSE-RoBERTalarge	Spearman Correlation	0.82	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.81	—	Unverified
6	SentenceBERT	Spearman Correlation	0.75	—	Unverified
7	SRoBERTa-NLI-base	Spearman Correlation	0.74	—	Unverified
8	SRoBERTa-NLI-large	Spearman Correlation	0.74	—	Unverified
9	Dino (STS/̄🦕)	Spearman Correlation	0.74	—	Unverified
10	SBERT-NLI-large	Spearman Correlation	0.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-LLaMA-7B	Spearman Correlation	0.91	—	Unverified
2	AnglE-LLaMA-7B-v2	Spearman Correlation	0.91	—	Unverified
3	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.9	—	Unverified
4	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.9	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.9	—	Unverified
6	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.89	—	Unverified
7	Trans-Encoder-BERT-large-bi (unsup.)	Spearman Correlation	0.89	—	Unverified
8	Trans-Encoder-BERT-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
9	Trans-Encoder-RoBERTa-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
10	SimCSE-RoBERTa-large	Spearman Correlation	0.87	—	Unverified