SOTAVerified

Semantic Textual Similarity

Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.

Image source: Learning Semantic Textual Similarity from Conversations

Papers

Showing 751800 of 2381 papers

TitleStatusHype
Ranking-Enhanced Unsupervised Sentence Representation LearningCode1
SUPER-Rec: SUrrounding Position-Enhanced Representation for Recommendation0
Towards explainable evaluation of language models on the semantic similarity of visual concepts0
VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene GraphCode0
Monolingual alignment of word senses and definitions in lexicographical resources0
Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples0
Selective Text Augmentation with Word Roles for Low-Resource Text ClassificationCode0
Zero-shot Event Causality Identification with Question Answering0
Combining Structured and Unstructured Knowledge in an Interactive Search Dialogue System0
Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne0
Addressing Token Uniformity in Transformers via Singular Value TransformationCode0
Graph-Augmented Cyclic Learning Framework for Similarity Estimation of Medical Clinical Notes0
Performance Optimization for Semantic Communications: An Attention-based Reinforcement Learning Approach0
MENLI: Robust Evaluation Metrics from Natural Language InferenceCode1
LLM.int8(): 8-bit Matrix Multiplication for Transformers at ScaleCode5
Paraphrasing, textual entailment, and semantic similarity above word level0
Compositional Evaluation on Japanese Textual Entailment and SimilarityCode1
Using Sentence Embeddings and Semantic Similarity for Seeking Consensus when Assessing Trustworthy AICode0
Towards Semantic Communications: Deep Learning-Based Image Semantic Coding0
Patents Phrase to Phrase Semantic Matching Dataset0
Uncertainty-based Visual Question Answering: Estimating Semantic Inconsistency between Image and Knowledge Base0
A Cognitive Study on Semantic Similarity Analysis of Large Corpora: A Transformer-based Approach0
The Birth of Bias: A case study on the evolution of gender bias in an English language modelCode0
Tackling Long-Tailed Category Distribution Under Domain ShiftsCode1
Semantic Novelty Detection via Relational ReasoningCode1
Entity-enhanced Adaptive Reconstruction Network for Weakly Supervised Referring Expression GroundingCode0
Explainable Legal Case Matching via Inverse Optimal Transport-based Rationale ExtractionCode1
Early Discovery of Emerging Entities in Persian Twitter with Semantic Similarity0
SURF: Semantic-level Unsupervised Reward Function for Machine Translation0
EMBEDDIA at SemEval-2022 Task 8: Investigating Sentence, Image, and Knowledge Graph Representations for Multilingual News Article SimilarityCode0
Syn2Vec: Synset Colexification Graphs for Lexical Semantic SimilarityCode0
BL.Research at SemEval-2022 Task 8: Using various Semantic Information to evaluate document-level Semantic Textual SimilarityCode0
NER4ID at SemEval-2022 Task 2: Named Entity Recognition for Idiomaticity DetectionCode0
ValCAT: Variable-Length Contextualized Adversarial Transformations Using Encoder-Decoder Language ModelCode0
Unsupervised Knowledge Graph Generation Using Semantic Similarity MatchingCode0
On the Effectiveness of Sentence Encoding for Intent Detection Meta-LearningCode1
Team dina at SemEval-2022 Task 8: Pre-trained Language Models as Baselines for Semantic Similarity0
A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation – through the Lens of Semantic Similarity Rating0
Learning Job Titles Similarity from Noisy Skill Labels0
Chinese Word Sense Embedding with SememeWSD and Synonym SetCode0
Exploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022Code0
Emphasizing Complementary Samples for Non-literal Cross-modal Retrieval0
Graph Component Contrastive Learning for Concept Relatedness EstimationCode0
Adversarial Self-Attention for Language UnderstandingCode0
Knowledge Graph Fusion for Language Model Fine-tuning0
SynWMD: Syntax-aware Word Mover's Distance for Sentence Similarity EvaluationCode1
Zero-shot object goal visual navigationCode1
Knowledge Graph Construction and Its Application in Automatic Radiology Report Generation from Radiologist's Dictation0
Highlights of Semantics in Multi-objective Genetic Programming0
Sentence Pair Embeddings Based Evaluation Metric for Abstractive and Extractive Summarization0
Show:102550
← PrevPage 16 of 48Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SMARTRoBERTaDev Pearson Correlation92.8Unverified
2DeBERTa (large)Accuracy92.5Unverified
3SMART-BERTDev Pearson Correlation90Unverified
4MT-DNN-SMARTPearson Correlation0.93Unverified
5StructBERTRoBERTa ensemblePearson Correlation0.93Unverified
6Mnet-SimPearson Correlation0.93Unverified
7XLNet (single model)Pearson Correlation0.93Unverified
8ALBERTPearson Correlation0.93Unverified
9T5-11BPearson Correlation0.93Unverified
10RoBERTaPearson Correlation0.92Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-UAESpearman Correlation84.54Unverified
2ST5-XXLSpearman Correlation82.63Unverified
3ST5-LargeSpearman Correlation81.83Unverified
4ST5-XLSpearman Correlation81.66Unverified
5ST5-BaseSpearman Correlation81.14Unverified
6MPNet-multilingualSpearman Correlation80.73Unverified
7SGPT-5.8B-nliSpearman Correlation80.53Unverified
8MPNetSpearman Correlation80.28Unverified
9MiniLM-L12Spearman Correlation79.8Unverified
10SimCSE-BERT-supSpearman Correlation79.12Unverified
#ModelMetricClaimedVerifiedStatus
1MT-DNN-SMARTAccuracy93.7Unverified
2ALBERTAccuracy93.4Unverified
3RoBERTa (ensemble)Accuracy92.3Unverified
4BigBirdF191.5Unverified
5StructBERTRoBERTa ensembleAccuracy91.5Unverified
6FLOATER-largeAccuracy91.4Unverified
7SMARTAccuracy91.3Unverified
8RoBERTa-large 355M (MLP quantized vector-wise, fine-tuned)Accuracy91Unverified
9RoBERTa-large 355M + Entailment as Few-shot LearnerF191Unverified
10SpanBERTAccuracy90.9Unverified
#ModelMetricClaimedVerifiedStatus
1PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.82Unverified
2PromptEOL+CSE+LLaMA-30BSpearman Correlation0.82Unverified
3PromptEOL+CSE+OPT-13BSpearman Correlation0.82Unverified
4SimCSE-RoBERTalargeSpearman Correlation0.82Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.81Unverified
6SentenceBERTSpearman Correlation0.75Unverified
7SRoBERTa-NLI-baseSpearman Correlation0.74Unverified
8SRoBERTa-NLI-largeSpearman Correlation0.74Unverified
9Dino (STS/̄🦕)Spearman Correlation0.74Unverified
10SBERT-NLI-largeSpearman Correlation0.74Unverified
#ModelMetricClaimedVerifiedStatus
1AnglE-LLaMA-7BSpearman Correlation0.91Unverified
2AnglE-LLaMA-7B-v2Spearman Correlation0.91Unverified
3PromptEOL+CSE+LLaMA-30BSpearman Correlation0.9Unverified
4PromptEOL+CSE+OPT-13BSpearman Correlation0.9Unverified
5PromptEOL+CSE+OPT-2.7BSpearman Correlation0.9Unverified
6PromCSE-RoBERTa-large (0.355B)Spearman Correlation0.89Unverified
7Trans-Encoder-BERT-large-bi (unsup.)Spearman Correlation0.89Unverified
8Trans-Encoder-BERT-large-cross (unsup.)Spearman Correlation0.88Unverified
9Trans-Encoder-RoBERTa-large-cross (unsup.)Spearman Correlation0.88Unverified
10SimCSE-RoBERTa-largeSpearman Correlation0.87Unverified