Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1501–1525 of 2381 papers

Title	Date	Tasks	Status	Hype
Characters or Morphemes: How to Represent Words?	Jul 1, 2018	Representation LearningSemantic Textual Similarity	—Unverified	0
WordNet Embeddings	Jul 1, 2018	Representation LearningSemantic Similarity	CodeCode Available	0
Learning Distributional Token Representations from Visual Features	Jul 1, 2018	Machine TranslationNMT	—Unverified	0
A Short Answer Grading System in Chinese by Support Vector Approach	Jul 1, 2018	BIG-bench Machine LearningSemantic Textual Similarity	—Unverified	0
Injecting Lexical Contrast into Word Vectors by Guiding Vector Space Specialisation	Jul 1, 2018	Dialogue State TrackingRepresentation Learning	—Unverified	0
Exploring Semantic Properties of Sentence Embeddings	Jul 1, 2018	Machine TranslationReading Comprehension	—Unverified	0
Are BLEU and Meaning Representation in Opposition?	Jul 1, 2018	General ClassificationMachine Translation	—Unverified	0
Explicit Retrofitting of Distributional Word Vectors	Jul 1, 2018	dialog state trackingLexical Simplification	—Unverified	0
Learning Thematic Similarity Metric from Article Sections Using Triplet Networks	Jul 1, 2018	ArticlesClustering	—Unverified	0
A Spatial Model for Extracting and Visualizing Latent Discourse Structure in Text	Jul 1, 2018	Information RetrievalReading Comprehension	—Unverified	0
Learning-based Composite Metrics for Improved Caption Evaluation	Jul 1, 2018	Image CaptioningLanguage Modeling	—Unverified	0
Using pseudo-senses for improving the extraction of synonyms from word embeddings	Jul 1, 2018	Dimensionality ReductionSemantic Similarity	—Unverified	0
Paragraph-based complex networks: application to document classification and authenticity verification	Jun 22, 2018	DiversityDocument Classification	—Unverified	0
The Corpus Replication Task	Jun 20, 2018	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Neural Network Models for Paraphrase Identification, Semantic Textual Similarity, Natural Language Inference, and Question Answering	Jun 12, 2018	Natural Language InferenceParaphrase Identification	CodeCode Available	0
Improving Language Understanding by Generative Pre-Training	Jun 11, 2018	Cloze TestDocument Classification	CodeCode Available	1
Deploying Deep Ranking Models for Search Verticals	Jun 6, 2018	BIG-bench Machine LearningSemantic Similarity	—Unverified	0
Semi-Supervised Clustering with Neural Networks	Jun 5, 2018	ClusteringDeep Clustering	—Unverified	0
Phrase-Level Metaphor Identification Using Distributed Representations of Word Meaning	Jun 1, 2018	Machine TranslationSemantic Textual Similarity	—Unverified	0
GKR: the Graphical Knowledge Representation for semantic parsing	Jun 1, 2018	Natural Language InferenceSemantic Parsing	—Unverified	0
Predicting Human Metaphor Paraphrase Judgments with Deep Neural Networks	Jun 1, 2018	Binary ClassificationClassification	—Unverified	0
Igevorse at SemEval-2018 Task 10: Exploring an Impact of Word Embeddings Concatenation for Capturing Discriminative Attributes	Jun 1, 2018	BIG-bench Machine LearningGeneral Classification	—Unverified	0
ITNLP-ARC at SemEval-2018 Task 12: Argument Reasoning Comprehension with Attention	Jun 1, 2018	ARCInformation Retrieval	—Unverified	0
ALB at SemEval-2018 Task 10: A System for Capturing Discriminative Attributes	Jun 1, 2018	AttributeDependency Parsing	—Unverified	0
Meaning\_space at SemEval-2018 Task 10: Combining explicitly encoded knowledge with information extracted from word embeddings	Jun 1, 2018	Semantic Textual SimilarityWord Embeddings	—Unverified	0

Show:10 25 50

← PrevPage 61 of 96Next →

All datasets STS Benchmark MTEB MRPC SICK STS13 STS14 STS12 STS15 STS16 MRPC Dev SentEval SICK-R

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SMARTRoBERTa	Dev Pearson Correlation	92.8	—	Unverified
2	DeBERTa (large)	Accuracy	92.5	—	Unverified
3	SMART-BERT	Dev Pearson Correlation	90	—	Unverified
4	MT-DNN-SMART	Pearson Correlation	0.93	—	Unverified
5	StructBERTRoBERTa ensemble	Pearson Correlation	0.93	—	Unverified
6	Mnet-Sim	Pearson Correlation	0.93	—	Unverified
7	XLNet (single model)	Pearson Correlation	0.93	—	Unverified
8	ALBERT	Pearson Correlation	0.93	—	Unverified
9	T5-11B	Pearson Correlation	0.93	—	Unverified
10	RoBERTa	Pearson Correlation	0.92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-UAE	Spearman Correlation	84.54	—	Unverified
2	ST5-XXL	Spearman Correlation	82.63	—	Unverified
3	ST5-Large	Spearman Correlation	81.83	—	Unverified
4	ST5-XL	Spearman Correlation	81.66	—	Unverified
5	ST5-Base	Spearman Correlation	81.14	—	Unverified
6	MPNet-multilingual	Spearman Correlation	80.73	—	Unverified
7	SGPT-5.8B-nli	Spearman Correlation	80.53	—	Unverified
8	MPNet	Spearman Correlation	80.28	—	Unverified
9	MiniLM-L12	Spearman Correlation	79.8	—	Unverified
10	SimCSE-BERT-sup	Spearman Correlation	79.12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MT-DNN-SMART	Accuracy	93.7	—	Unverified
2	ALBERT	Accuracy	93.4	—	Unverified
3	RoBERTa (ensemble)	Accuracy	92.3	—	Unverified
4	BigBird	F1	91.5	—	Unverified
5	StructBERTRoBERTa ensemble	Accuracy	91.5	—	Unverified
6	FLOATER-large	Accuracy	91.4	—	Unverified
7	SMART	Accuracy	91.3	—	Unverified
8	RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)	Accuracy	91	—	Unverified
9	RoBERTa-large 355M + Entailment as Few-shot Learner	F1	91	—	Unverified
10	SpanBERT	Accuracy	90.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.82	—	Unverified
2	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.82	—	Unverified
3	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.82	—	Unverified
4	SimCSE-RoBERTalarge	Spearman Correlation	0.82	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.81	—	Unverified
6	SentenceBERT	Spearman Correlation	0.75	—	Unverified
7	SRoBERTa-NLI-base	Spearman Correlation	0.74	—	Unverified
8	SRoBERTa-NLI-large	Spearman Correlation	0.74	—	Unverified
9	Dino (STS/̄🦕)	Spearman Correlation	0.74	—	Unverified
10	SBERT-NLI-large	Spearman Correlation	0.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-LLaMA-7B	Spearman Correlation	0.91	—	Unverified
2	AnglE-LLaMA-7B-v2	Spearman Correlation	0.91	—	Unverified
3	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.9	—	Unverified
4	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.9	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.9	—	Unverified
6	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.89	—	Unverified
7	Trans-Encoder-BERT-large-bi (unsup.)	Spearman Correlation	0.89	—	Unverified
8	Trans-Encoder-BERT-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
9	Trans-Encoder-RoBERTa-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
10	SimCSE-RoBERTa-large	Spearman Correlation	0.87	—	Unverified