SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 16511700 of 2381 papers

TitleStatusHype
Classifying Frames at the Sentence Level in News Articles0
Variational Inference for Logical Inference0
Czech Dataset for Semantic Similarity and Relatedness0
Learning to Score System Summaries for Better Content Selection Evaluation.0
Lexical Chains meet Word Embeddings in Document-level Statistical Machine Translation0
Latent Space Embedding for Retrieval in Question-Answer Archives0
Exploring Vector Spaces for Semantic Relations0
Speaking, Seeing, Understanding: Correlating semantic models with conceptual representation in the brain0
Identifying Cognate Sets Across Dictionaries of Related LanguagesCode0
Author-aware Aspect Topic Sentiment Model to Retrieve Supporting Opinions from Reviews0
Dual Tensor Model for Detecting Asymmetric Lexico-Semantic Relations0
Parameter Transfer across Domains for Word Sense Disambiguation0
Word Embeddings based on Fixed-Size Ordinally Forgetting Encoding0
Portuguese Word Embeddings: Evaluating on Word Analogies and Natural Language TasksCode0
ClaC: Semantic Relatedness of Words and Phrases0
Gold Standard Online Debates Summaries and First Experiments Towards Automatic Summarization of Online Debate Data0
Learning Contextual Embeddings for Structural Semantic Similarity using Categorical Information0
HHU at SemEval-2017 Task 2: Fast Hash-Based Embeddings for Semantic Word Similarity Assessment0
Wild Devs' at SemEval-2017 Task 2: Using Neural Networks to Discover Word Similarity0
ResSim at SemEval-2017 Task 1: Multilingual Word Representations for Semantic Textual Similarity0
What Analogies Reveal about Word Vectors and their Compositionality0
Comparing Approaches for Automatic Question Identification0
Ways of Asking and Replying in Duplicate Question Detection0
RTM at SemEval-2017 Task 1: Referential Translation Machines for Predicting Semantic Similarity0
OPI-JSA at SemEval-2017 Task 1: Application of Ensemble learning for computing semantic textual similarity0
RUFINO at SemEval-2017 Task 2: Cross-lingual lexical similarity by extending PMI and word embeddings systems with a Swadesh's-like list0
HCTI at SemEval-2017 Task 1: Use convolutional neural network to evaluate Semantic Textual Similarity0
HCCL at SemEval-2017 Task 2: Combining Multilingual Word Embeddings and Transliteration Model for Semantic Similarity0
SEF@UHH at SemEval-2017 Task 1: Unsupervised Knowledge-Free Semantic Textual Similarity via Paragraph Vector0
Information Navigation System with Discovering User Interests0
A Graph Based Semi-Supervised Approach for Analysis of Derivational Nouns in Sanskrit0
BUCC 2017 Shared Task: a First Attempt Toward a Deep Learning Framework for Identifying Parallel Sentences in Comparable Corpora0
PurdueNLP at SemEval-2017 Task 1: Predicting Semantic Textual Similarity with Paraphrase and Event Embeddings0
Does Free Word Order Hurt? Assessing the Practical Lexical Function Model for Croatian0
BIT at SemEval-2017 Task 1: Using Semantic Information Space to Evaluate Semantic Textual Similarity0
QLUT at SemEval-2017 Task 1: Semantic Textual Similarity Based on Word Embeddings0
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation0
SemEval-2017 Task 2: Multilingual and Cross-lingual Semantic Word Similarity0
ITNLP-AiKF at SemEval-2017 Task 1: Rich Features Based SVR for Semantic Textual Similarity Computing0
DT\_Team at SemEval-2017 Task 1: Semantic Similarity Using Alignments, Sentence-Level Embeddings and Gaussian Mixture Model Output0
Sew-Embed at SemEval-2017 Task 2: Language-Independent Concept Representations from a Semantically Enriched WikipediaCode0
FCICU at SemEval-2017 Task 1: Sense-Based Language Independent Semantic Textual Similarity Approach0
Jmp8 at SemEval-2017 Task 2: A simple and general distributional approach to estimate word similarityCode0
SimBow at SemEval-2017 Task 3: Soft-Cosine Semantic Similarity between Questions for Community Question Answering0
MITRE at SemEval-2017 Task 1: Simple Semantic Similarity0
ECNU at SemEval-2017 Task 1: Leverage Kernel-based Traditional NLP features and Neural Networks to Build a Universal Model for Multilingual and Cross-lingual Semantic Textual Similarity0
ECNU at SemEval-2017 Task 3: Using Traditional and Deep Learning Methods to Address Community Question Answering Task0
ECNU at SemEval-2017 Task 7: Using Supervised and Unsupervised Methods to Detect and Locate English Puns0
UMDeep at SemEval-2017 Task 1: End-to-End Shared Weight LSTM Model for Semantic Textual Similarity0
QU-BIGIR at SemEval 2017 Task 3: Using Similarity Features for Arabic Community Question Answering Forums0
Show:102550
← PrevPage 34 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified