Semantic Textual Similarity
Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.
Image source: Learning Semantic Textual Similarity from Conversations
Papers
Showing 1–10 of 2381 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | AnglE-LLaMA-7B | Spearman Correlation | 0.91 | — | Unverified |
| 2 | AnglE-LLaMA-7B-v2 | Spearman Correlation | 0.91 | — | Unverified |
| 3 | PromptEOL+CSE+LLaMA-30B | Spearman Correlation | 0.9 | — | Unverified |
| 4 | PromptEOL+CSE+OPT-13B | Spearman Correlation | 0.9 | — | Unverified |
| 5 | PromptEOL+CSE+OPT-2.7B | Spearman Correlation | 0.9 | — | Unverified |
| 6 | PromCSE-RoBERTa-large (0.355B) | Spearman Correlation | 0.89 | — | Unverified |
| 7 | Trans-Encoder-BERT-large-bi (unsup.) | Spearman Correlation | 0.89 | — | Unverified |
| 8 | Trans-Encoder-BERT-large-cross (unsup.) | Spearman Correlation | 0.88 | — | Unverified |
| 9 | Trans-Encoder-RoBERTa-large-cross (unsup.) | Spearman Correlation | 0.88 | — | Unverified |
| 10 | SimCSE-RoBERTa-large | Spearman Correlation | 0.87 | — | Unverified |