Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1301–1325 of 2381 papers

Title	Date	Tasks	Status	Hype
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation	Nov 8, 2019	Articlescounterfactual	—Unverified	0
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization	Nov 8, 2019	Linguistic AcceptabilityNatural Language Inference	CodeCode Available	1
Explicit Pairwise Word Interaction Modeling Improves Pretrained Transformers for English Semantic Similarity Tasks	Nov 7, 2019	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Gextext: Disease Network Extraction from Biomedical Literature	Nov 6, 2019	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Machine Translation Evaluation using Bi-directional Entailment	Nov 2, 2019	Machine TranslationSemantic Similarity	—Unverified	0
Cross-lingual Semantic Specialization via Lexical Relation Induction	Nov 1, 2019	dialog state trackingLexical Simplification	—Unverified	0
Incorporating Contextual and Syntactic Structures Improves Semantic Similarity Modeling	Nov 1, 2019	Natural Language InferenceQuestion Answering	—Unverified	0
Fully Unsupervised Crosslingual Semantic Textual Similarity Metric Based on BERT for Identifying Parallel Data	Nov 1, 2019	Machine TranslationNatural Language Understanding	—Unverified	0
Text Emotion Distribution Learning from Small Sample: A Meta-Learning Approach	Nov 1, 2019	Meta-LearningSemantic Similarity	—Unverified	0
Team GPLSI. Approach for automated fact checking	Nov 1, 2019	ArticlesFact Checking	—Unverified	0
Normalising Non-standardised Orthography in Algerian Code-switched User-generated Data	Nov 1, 2019	DecoderSemantic Textual Similarity	—Unverified	0
Towards Actual (Not Operational) Textual Style Transfer Auto-Evaluation	Nov 1, 2019	Semantic SimilaritySemantic Textual Similarity	—Unverified	0
Wasserstein distances for evaluating cross-lingual embeddings	Oct 24, 2019	Cross-Lingual Document ClassificationDocument Classification	—Unverified	0
A Novel Approach for Automatic Bengali Question Answering System using Semantic Similarity Analysis	Oct 23, 2019	POSPOS Tagging	—Unverified	0
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer	Oct 23, 2019	Answer GenerationCommon Sense Reasoning	CodeCode Available	2
Textual analysis of artificial intelligence manuscripts reveals features associated with peer review outcome	Oct 21, 2019	Semantic SimilaritySemantic Textual Similarity	CodeCode Available	0
A Comparison of Semantic Similarity Methods for Maximum Human Interpretability	Oct 21, 2019	Information RetrievalRetrieval	—Unverified	0
Measuring semantic similarity of clinical trial outcomes using deep pre-trained language representations	Oct 17, 2019	Deep LearningSemantic Similarity	—Unverified	0
Universal Text Representation from BERT: An Empirical Study	Oct 17, 2019	Learning-To-RankNatural Language Inference	—Unverified	0
Q8BERT: Quantized 8Bit BERT	Oct 14, 2019	Linguistic AcceptabilityNatural Language Inference	CodeCode Available	1
Learning Analogy-Preserving Sentence Embeddings for Answer Selection	Oct 11, 2019	Answer SelectionQuestion Answering	—Unverified	0
Domain-Relevant Embeddings for Medical Question Similarity	Oct 9, 2019	Question AnsweringQuestion Similarity	—Unverified	0
Learning event representations for temporal segmentation of image sequences by dynamic graph embedding	Oct 8, 2019	Domain AdaptationDynamic graph embedding	—Unverified	0
Correlations between Word Vector Sets	Oct 7, 2019	Semantic Textual SimilaritySTS	CodeCode Available	0
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter	Oct 2, 2019	Hate Speech DetectionKnowledge Distillation	CodeCode Available	1

Show:10 25 50

← PrevPage 53 of 96Next →

All datasets STS Benchmark MTEB MRPC SICK STS13 STS14 STS12 STS15 STS16 MRPC Dev SentEval SICK-R

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	SMARTRoBERTa	Dev Pearson Correlation	92.8	—	Unverified
2	DeBERTa (large)	Accuracy	92.5	—	Unverified
3	SMART-BERT	Dev Pearson Correlation	90	—	Unverified
4	MT-DNN-SMART	Pearson Correlation	0.93	—	Unverified
5	StructBERTRoBERTa ensemble	Pearson Correlation	0.93	—	Unverified
6	Mnet-Sim	Pearson Correlation	0.93	—	Unverified
7	XLNet (single model)	Pearson Correlation	0.93	—	Unverified
8	ALBERT	Pearson Correlation	0.93	—	Unverified
9	T5-11B	Pearson Correlation	0.93	—	Unverified
10	RoBERTa	Pearson Correlation	0.92	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-UAE	Spearman Correlation	84.54	—	Unverified
2	ST5-XXL	Spearman Correlation	82.63	—	Unverified
3	ST5-Large	Spearman Correlation	81.83	—	Unverified
4	ST5-XL	Spearman Correlation	81.66	—	Unverified
5	ST5-Base	Spearman Correlation	81.14	—	Unverified
6	MPNet-multilingual	Spearman Correlation	80.73	—	Unverified
7	SGPT-5.8B-nli	Spearman Correlation	80.53	—	Unverified
8	MPNet	Spearman Correlation	80.28	—	Unverified
9	MiniLM-L12	Spearman Correlation	79.8	—	Unverified
10	SimCSE-BERT-sup	Spearman Correlation	79.12	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	MT-DNN-SMART	Accuracy	93.7	—	Unverified
2	ALBERT	Accuracy	93.4	—	Unverified
3	RoBERTa (ensemble)	Accuracy	92.3	—	Unverified
4	BigBird	F1	91.5	—	Unverified
5	StructBERTRoBERTa ensemble	Accuracy	91.5	—	Unverified
6	FLOATER-large	Accuracy	91.4	—	Unverified
7	SMART	Accuracy	91.3	—	Unverified
8	RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)	Accuracy	91	—	Unverified
9	RoBERTa-large 355M + Entailment as Few-shot Learner	F1	91	—	Unverified
10	SpanBERT	Accuracy	90.9	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.82	—	Unverified
2	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.82	—	Unverified
3	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.82	—	Unverified
4	SimCSE-RoBERTalarge	Spearman Correlation	0.82	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.81	—	Unverified
6	SentenceBERT	Spearman Correlation	0.75	—	Unverified
7	SRoBERTa-NLI-base	Spearman Correlation	0.74	—	Unverified
8	SRoBERTa-NLI-large	Spearman Correlation	0.74	—	Unverified
9	Dino (STS/̄🦕)	Spearman Correlation	0.74	—	Unverified
10	SBERT-NLI-large	Spearman Correlation	0.74	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	AnglE-LLaMA-7B	Spearman Correlation	0.91	—	Unverified
2	AnglE-LLaMA-7B-v2	Spearman Correlation	0.91	—	Unverified
3	PromptEOL+CSE+LLaMA-30B	Spearman Correlation	0.9	—	Unverified
4	PromptEOL+CSE+OPT-13B	Spearman Correlation	0.9	—	Unverified
5	PromptEOL+CSE+OPT-2.7B	Spearman Correlation	0.9	—	Unverified
6	PromCSE-RoBERTa-large (0.355B)	Spearman Correlation	0.89	—	Unverified
7	Trans-Encoder-BERT-large-bi (unsup.)	Spearman Correlation	0.89	—	Unverified
8	Trans-Encoder-BERT-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
9	Trans-Encoder-RoBERTa-large-cross (unsup.)	Spearman Correlation	0.88	—	Unverified
10	SimCSE-RoBERTa-large	Spearman Correlation	0.87	—	Unverified