Semantic Textual Similarity
Semantic textual similarity deals with determining how similar two pieces of texts are. This can take the form of assigning a score from 1 to 5. Related tasks are paraphrase or duplicate identification.
Image source: Learning Semantic Textual Similarity from Conversations
Papers
Showing 1–10 of 2381 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | PromptEOL+CSE+OPT-13B | Spearman Correlation | 0.8 | — | Unverified |
| 2 | PromptEOL+CSE+LLaMA-30B | Spearman Correlation | 0.8 | — | Unverified |
| 3 | PromCSE-RoBERTa-large (0.355B) | Spearman Correlation | 0.8 | — | Unverified |
| 4 | PromptEOL+CSE+OPT-2.7B | Spearman Correlation | 0.79 | — | Unverified |
| 5 | AnglE-LLaMA-7B | Spearman Correlation | 0.79 | — | Unverified |
| 6 | AnglE-LLaMA-13B | Spearman Correlation | 0.79 | — | Unverified |
| 7 | Trans-Encoder-RoBERTa-large-cross (unsup.) | Spearman Correlation | 0.78 | — | Unverified |
| 8 | Trans-Encoder-BERT-large-bi (unsup.) | Spearman Correlation | 0.78 | — | Unverified |
| 9 | SimCSE-RoBERTa-large | Spearman Correlation | 0.77 | — | Unverified |
| 10 | Trans-Encoder-RoBERTa-base-cross (unsup.) | Spearman Correlation | 0.76 | — | Unverified |