Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 776–800 of 2381 papers

Title	Date	Tasks	Status	Hype
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression Grounding	Jul 18, 2022	AttributeReferring Expression	CodeCode Available	0
Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale Extraction	Jul 9, 2022	Explanation GenerationFairness	CodeCode Available	1
Early Discovery of Emerging Entities in Persian Twitter with Semantic Similarity	Jul 6, 2022	ClusteringDecision Making	—Unverified	0
SURF: Semantic-level Unsupervised Reward Function for Machine Translation	Jul 1, 2022	DiversityMachine Translation	—Unverified	0
EMBEDDIA at SemEval-2022 Task 8: Investigating Sentence, Image, and Knowledge Graph Representations for Multilingual News Article Similarity	Jul 1, 2022	ArticlesSemantic Similarity	CodeCode Available	0
Syn2Vec: Synset Colexification Graphs for Lexical Semantic Similarity	Jul 1, 2022	Semantic SimilaritySemantic Textual Similarity	CodeCode Available	0
BL.Research at SemEval-2022 Task 8: Using various Semantic Information to evaluate document-level Semantic Textual Similarity	Jul 1, 2022	Document ClassificationSemantic Textual Similarity	CodeCode Available	0
NER4ID at SemEval-2022 Task 2: Named Entity Recognition for Idiomaticity Detection	Jul 1, 2022	named-entity-recognitionNamed Entity Recognition	CodeCode Available	0
ValCAT: Variable-Length Contextualized Adversarial Transformations Using Encoder-Decoder Language Model	Jul 1, 2022	DecoderLanguage Modeling	CodeCode Available	0
Unsupervised Knowledge Graph Generation Using Semantic Similarity Matching	Jul 1, 2022	Graph GenerationSemantic Similarity	CodeCode Available	0
On the Effectiveness of Sentence Encoding for Intent Detection Meta-Learning	Jul 1, 2022	Intent DetectionMeta-Learning	CodeCode Available	1
Team dina at SemEval-2022 Task 8: Pre-trained Language Models as Baselines for Semantic Similarity	Jul 1, 2022	ArticlesMachine Translation	—Unverified	0
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation – through the Lens of Semantic Similarity Rating	Jul 1, 2022	nlg evaluationSemantic Similarity	—Unverified	0
Learning Job Titles Similarity from Noisy Skill Labels	Jul 1, 2022	Representation LearningSemantic Similarity	—Unverified	0
Chinese Word Sense Embedding with SememeWSD and Synonym Set	Jun 29, 2022	Semantic SimilaritySemantic Textual Similarity	CodeCode Available	0
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022	Jun 29, 2022	Multi-Instance RetrievalRetrieval	CodeCode Available	0
Emphasizing Complementary Samples for Non-literal Cross-modal Retrieval	Jun 25, 2022	Cross-Modal RetrievalRetrieval	—Unverified	0
Graph Component Contrastive Learning for Concept Relatedness Estimation	Jun 25, 2022	Contrastive LearningData Augmentation	CodeCode Available	0
Adversarial Self-Attention for Language Understanding	Jun 25, 2022	Machine Reading ComprehensionNamed Entity Recognition (NER)	CodeCode Available	0
Knowledge Graph Fusion for Language Model Fine-tuning	Jun 21, 2022	Language ModelingLanguage Modelling	—Unverified	0
SynWMD: Syntax-aware Word Mover's Distance for Sentence Similarity Evaluation	Jun 20, 2022	Semantic SimilaritySemantic Textual Similarity	CodeCode Available	1
Zero-shot object goal visual navigation	Jun 15, 2022	Knowledge GraphsObject	CodeCode Available	1
Knowledge Graph Construction and Its Application in Automatic Radiology Report Generation from Radiologist's Dictation	Jun 13, 2022	graph constructionSemantic Similarity	—Unverified	0
Highlights of Semantics in Multi-objective Genetic Programming	Jun 10, 2022	Binary ClassificationDiversity	—Unverified	0
Sentence Pair Embeddings Based Evaluation Metric for Abstractive and Extractive Summarization	Jun 1, 2022	Extractive SummarizationNatural Language Inference	—Unverified	0

Show:10 25 50

← PrevPage 32 of 96Next →

All datasets STS Benchmark MTEB MRPC SICK STS13 STS14 STS12 STS15 STS16 MRPC Dev SentEval SICK-R

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SMARTRoBERTa	Dev Pearson Correlation	92.8	—	Unverified
2	DeBERTa (large)	Accuracy	92.5	—	Unverified
3	SMART-BERT	Dev Pearson Correlation	90	—	Unverified
4	MT-DNN-SMART	Pearson Correlation	0.93	—	Unverified
5	StructBERTRoBERTa ensemble	Pearson Correlation	0.93	—	Unverified
6	Mnet-Sim	Pearson Correlation	0.93	—	Unverified
7	XLNet (single model)	Pearson Correlation	0.93	—	Unverified
8	ALBERT	Pearson Correlation	0.93	—	Unverified
9	T5-11B	Pearson Correlation	0.93	—	Unverified
10	RoBERTa	Pearson Correlation	0.92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-UAE	Spearman Correlation	84.54	—	Unverified
2	ST5-XXL	Spearman Correlation	82.63	—	Unverified
3	ST5-Large	Spearman Correlation	81.83	—	Unverified
4	ST5-XL	Spearman Correlation	81.66	—	Unverified
5	ST5-Base	Spearman Correlation	81.14	—	Unverified
6	MPNet-multilingual	Spearman Correlation	80.73	—	Unverified
7	SGPT-5.8B-nli	Spearman Correlation	80.53	—	Unverified
8	MPNet	Spearman Correlation	80.28	—	Unverified
9	MiniLM-L12	Spearman Correlation	79.8	—	Unverified
10	SimCSE-BERT-sup	Spearman Correlation	79.12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MT-DNN-SMART	Accuracy	93.7	—	Unverified
2	ALBERT	Accuracy	93.4	—	Unverified
3	RoBERTa (ensemble)	Accuracy	92.3	—	Unverified
4	BigBird	F1	91.5	—	Unverified
5	StructBERTRoBERTa ensemble	Accuracy	91.5	—	Unverified
6	FLOATER-large	Accuracy	91.4	—	Unverified
7	SMART	Accuracy	91.3	—	Unverified
8	RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)	Accuracy	91	—	Unverified
9	RoBERTa-large 355M + Entailment as Few-shot Learner	F1	91	—	Unverified
10	SpanBERT	Accuracy	90.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.82	—	Unverified
2	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.82	—	Unverified
3	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.82	—	Unverified
4	SimCSE-RoBERTalarge	Spearman Correlation	0.82	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.81	—	Unverified
6	SentenceBERT	Spearman Correlation	0.75	—	Unverified
7	SRoBERTa-NLI-base	Spearman Correlation	0.74	—	Unverified
8	SRoBERTa-NLI-large	Spearman Correlation	0.74	—	Unverified
9	Dino (STS/̄🦕)	Spearman Correlation	0.74	—	Unverified
10	SBERT-NLI-large	Spearman Correlation	0.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-LLaMA-7B	Spearman Correlation	0.91	—	Unverified
2	AnglE-LLaMA-7B-v2	Spearman Correlation	0.91	—	Unverified
3	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.9	—	Unverified
4	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.9	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.9	—	Unverified
6	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.89	—	Unverified
7	Trans-Encoder-BERT-large-bi (unsup.)	Spearman Correlation	0.89	—	Unverified
8	Trans-Encoder-BERT-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
9	Trans-Encoder-RoBERTa-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
10	SimCSE-RoBERTa-large	Spearman Correlation	0.87	—	Unverified