Semantic Textual Similarity
Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.
Image source: Learning Semantic Textual Similarity from Conversations
Papers
Showing 1–10 of 2381 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | PromCSE-RoBERTa-large (0.355B) | Spearman Correlation | 0.82 | — | Unverified |
| 2 | PromptEOL+CSE+LLaMA-30B | Spearman Correlation | 0.82 | — | Unverified |
| 3 | PromptEOL+CSE+OPT-13B | Spearman Correlation | 0.82 | — | Unverified |
| 4 | SimCSE-RoBERTalarge | Spearman Correlation | 0.82 | — | Unverified |
| 5 | PromptEOL+CSE+OPT-2.7B | Spearman Correlation | 0.81 | — | Unverified |
| 6 | SentenceBERT | Spearman Correlation | 0.75 | — | Unverified |
| 7 | SRoBERTa-NLI-base | Spearman Correlation | 0.74 | — | Unverified |
| 8 | SRoBERTa-NLI-large | Spearman Correlation | 0.74 | — | Unverified |
| 9 | Dino (STS/̄🦕) | Spearman Correlation | 0.74 | — | Unverified |
| 10 | SBERT-NLI-large | Spearman Correlation | 0.74 | — | Unverified |