Sign Language Translation
Given a video containing sign language, the task is to predict the translation into (written) spoken language.
Image credit: How2Sign
Papers
Showing 1–10 of 153 papers
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MSKA-SLT | BLEU-4 | 29.03 | — | Unverified |
| 2 | TwoStream-SLT | BLEU-4 | 28.95 | — | Unverified |
| 3 | SignBERT+ | BLEU-4 | 25.7 | — | Unverified |
| 4 | S2T Stochastic Transformer (Ens) | BLEU-4 | 25.59 | — | Unverified |
| 5 | STMC+Transformer (Ens) | BLEU-4 | 25.4 | — | Unverified |
| 6 | BN-TIN-Transf.+SignBT | BLEU-4 | 24.32 | — | Unverified |
| 7 | Signformer | BLEU-4 | 23.43 | — | Unverified |
| 8 | BERT2RND | BLEU-4 | 22.47 | — | Unverified |
| 9 | BN-TIN-Transf. | BLEU-4 | 21.68 | — | Unverified |
| 10 | BERT2BERT | BLEU-4 | 21.26 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | TwoStream-SLT | BLEU-4 | 25.79 | — | Unverified |
| 2 | MSKA-SLT | BLEU-4 | 25.52 | — | Unverified |
| 3 | MMTLB | BLEU-4 | 23.92 | — | Unverified |
| 4 | XmDA | BLEU-4 | 21.58 | — | Unverified |
| 5 | BN-TIN-Transf.+SignBT | BLEU-4 | 21.34 | — | Unverified |
| 6 | IP-SLT | BLEU-4 | 16.72 | — | Unverified |
| 7 | ConSLT | BLEU-4 | 14.53 | — | Unverified |
| 8 | BN-TIN-Transf. | BLEU-4 | 13.19 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Transformer Ens. | BLEU-4 | 82.87 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | BLEU | 8.03 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Keypoints-Transformer-UNLP | Word Error Rate (WER) | 0.94 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Transformer Baseline | BLEU-4 | 4.14 | — | Unverified |