SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Showing 101125 of 153 papers

TitleStatusHype
sign.mt: Real-Time Multilingual Sign Language Translation Application0
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale0
SignNet: Single Channel Sign Generation using Metric Embedded Learning0
Signs as Tokens: An Autoregressive Multilingual Sign Language Generator0
SimulSLT: End-to-End Simultaneous Sign Language Translation0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation0
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services0
Spatio-temporal transformer to support automatic sign language translation0
Speak2Sign3D: A Multi-modal Pipeline for English Speech to American Sign Language Animation0
Stream State-tying for Sign Language Recognition0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks0
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods0
Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool0
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production0
Unsupervised Sign Language Translation and Generation0
Using an LLM to Turn Sign Spottings into Spoken Language Sentences0
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation0
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text0
Optimised Preprocessing for Automatic Mouth Gesture Classification0
Prior Knowledge and Memory Enriched Transformer for Sign Language Translation0
Real-Time Multilingual Sign Language Processing0
Reconsidering Sentence-Level Sign Language Translation0
Scaling Sign Language Translation0
Scaling up Multimodal Pre-training for Sign Language Understanding0
Score-level Multi Cue Fusion for Sign Language Recognition0
Show:102550
← PrevPage 5 of 7Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03Unverified
2TwoStream-SLTBLEU-428.95Unverified
3SignBERT+BLEU-425.7Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59Unverified
5STMC+Transformer (Ens)BLEU-425.4Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32Unverified
7SignformerBLEU-423.43Unverified
8BERT2RNDBLEU-422.47Unverified
9BN-TIN-Transf.BLEU-421.68Unverified
10BERT2BERTBLEU-421.26Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79Unverified
2MSKA-SLTBLEU-425.52Unverified
3MMTLBBLEU-423.92Unverified
4XmDABLEU-421.58Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34Unverified
6IP-SLTBLEU-416.72Unverified
7ConSLTBLEU-414.53Unverified
8BN-TIN-Transf.BLEU-413.19Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14Unverified