SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 901950 of 2381 papers

TitleStatusHype
Speaker Clustering in Textual Dialogue with Pairwise Utterance Relation and Cross-corpus Dialogue Act Supervision0
Evaluation of taxonomic and neural embedding methods for calculating semantic similarity0
Word to Sentence Visual Semantic Similarity for Caption Generation: Lessons Learned0
Raising the Bar on the Evaluation of Out-of-Distribution Detection0
Unsupervised Hashing with Semantic Concept MiningCode0
An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings LearningCode0
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation MetricsCode0
A Closer Look at Novel Class Discovery from the Labeled Set0
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity MatchingCode0
Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention PoolingCode0
SUPER-Rec: SUrrounding Position-Enhanced Representation for Recommendation0
Towards explainable evaluation of language models on the semantic similarity of visual concepts0
VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene GraphCode0
Monolingual alignment of word senses and definitions in lexicographical resources0
Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples0
Selective Text Augmentation with Word Roles for Low-Resource Text ClassificationCode0
Combining Structured and Unstructured Knowledge in an Interactive Search Dialogue System0
Zero-shot Event Causality Identification with Question Answering0
Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne0
Addressing Token Uniformity in Transformers via Singular Value TransformationCode0
Graph-Augmented Cyclic Learning Framework for Similarity Estimation of Medical Clinical Notes0
Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approach0
Paraphrasing, textual entailment, and semantic similarity above word level0
Using Sentence Embeddings and Semantic Similarity for Seeking Consensus when Assessing Trustworthy AICode0
Towards Semantic Communications: Deep Learning-Based Image Semantic Coding0
Patents Phrase to Phrase Semantic Matching Dataset0
Uncertainty-based Visual Question Answering: Estimating Semantic Inconsistency between Image and Knowledge Base0
A Cognitive Study on Semantic Similarity Analysis of Large Corpora: A Transformer-based Approach0
The Birth of Bias: A case study on the evolution of gender bias in an English language modelCode0
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression GroundingCode0
Early Discovery of Emerging Entities in Persian Twitter with Semantic Similarity0
SURF: Semantic-level Unsupervised Reward Function for Machine Translation0
Team dina at SemEval-2022 Task 8: Pre-trained Language Models as Baselines for Semantic Similarity0
Syn2Vec: Synset Colexification Graphs for Lexical Semantic SimilarityCode0
Learning Job Titles Similarity from Noisy Skill Labels0
NER4ID at SemEval-2022 Task 2: Named Entity Recognition for Idiomaticity DetectionCode0
EMBEDDIA at SemEval-2022 Task 8: Investigating Sentence, Image, and Knowledge Graph Representations for Multilingual News Article SimilarityCode0
ValCAT: Variable-Length Contextualized Adversarial Transformations Using Encoder-Decoder Language ModelCode0
BL.Research at SemEval-2022 Task 8: Using various Semantic Information to evaluate document-level Semantic Textual SimilarityCode0
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation – through the Lens of Semantic Similarity Rating0
Unsupervised Knowledge Graph Generation Using Semantic Similarity MatchingCode0
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022Code0
Chinese Word Sense Embedding with SememeWSD and Synonym SetCode0
Graph Component Contrastive Learning for Concept Relatedness EstimationCode0
Emphasizing Complementary Samples for Non-literal Cross-modal Retrieval0
Adversarial Self-Attention for Language UnderstandingCode0
Knowledge Graph Fusion for Language Model Fine-tuning0
Knowledge Graph Construction and Its Application in Automatic Radiology Report Generation from Radiologist's Dictation0
Highlights of Semantics in Multi-objective Genetic Programming0
CLISTER : Un corpus pour la similarité sémantique textuelle dans des cas cliniques en français (CLISTER : A Corpus for Semantic Textual Similarity in French Clinical Narratives)0
Show:102550
← PrevPage 19 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified