Stance Detection
Stance detection is the extraction of a subject's reaction to a claim made by a primary actor. It is a core part of a set of approaches to fake news assessment.
Example:
- Source: "Apples are the most delicious fruit in existence"
- Reply: "Obviously not, because that is a reuben from Katz's"
- Stance: deny
Papers
No papers found.
All datasetsMGTABRumourEvalFNC-1ARC (AI2 Reasoning Challenge)argminDhoroniemergentiac1ibmcsmtsdPerspectrumpoldeb
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | RGT | Acc | 87.8 | — | Unverified |
| 2 | Simple-HGN | Acc | 85.3 | — | Unverified |
| 3 | GCN | Acc | 82.4 | — | Unverified |
| 4 | GAT | Acc | 82.2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 66.58 | — | Unverified |
| 2 | Kochkina et al. 2017 | Accuracy | 0.78 | — | Unverified |
| 3 | Bahuleyan and Vechtomova 2017 | Accuracy | 0.78 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 83.17 | — | Unverified |
| 2 | Transition Matrix | F1 | 77.76 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 64.82 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 62.79 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | BanglaBERT-Dhoroni | Accuracy | 0.64 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 82.1 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 56.97 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 88.06 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 63.96 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 83.11 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 52.76 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | COLA+GPT3.5 | Average F1 | 83.4 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Boosting | F1 | 0.87 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 64.71 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 58.72 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 78.61 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | BERT | Average F1 | 66 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MUSE + UMAP (Unsupervised) | Avg F1 | 0.86 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MUSE + UMAP (Unsupervised) | Avg F1 | 0.84 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 57.47 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TESTED | F1 | 70.98 | — | Unverified |