SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Showing 101125 of 153 papers

TitleStatusHype
Considerations for meaningful sign language machine translation based on glosses0
Content4All Open Research Sign Language Translation Datasets0
Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs0
Coupling Natural Language Processing and Animation Synthesis in Portuguese Sign Language Translation0
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis0
Data Augmentation for Sign Language Gloss Translation0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation0
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model0
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale0
SignNet: Single Channel Sign Generation using Metric Embedded Learning0
Signs as Tokens: An Autoregressive Multilingual Sign Language Generator0
SimulSLT: End-to-End Simultaneous Sign Language Translation0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation0
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services0
Spatio-temporal transformer to support automatic sign language translation0
Speak2Sign3D: A Multi-modal Pipeline for English Speech to American Sign Language Animation0
Stream State-tying for Sign Language Recognition0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks0
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods0
Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool0
Two-Stream Network for Sign Language Recognition and Translation0
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production0
Unsupervised Sign Language Translation and Generation0
Using an LLM to Turn Sign Spottings into Spoken Language Sentences0
Show:102550
← PrevPage 5 of 7Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03Unverified
2TwoStream-SLTBLEU-428.95Unverified
3SignBERT+BLEU-425.7Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59Unverified
5STMC+Transformer (Ens)BLEU-425.4Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32Unverified
7SignformerBLEU-423.43Unverified
8BERT2RNDBLEU-422.47Unverified
9BN-TIN-Transf.BLEU-421.68Unverified
10BERT2BERTBLEU-421.26Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79Unverified
2MSKA-SLTBLEU-425.52Unverified
3MMTLBBLEU-423.92Unverified
4XmDABLEU-421.58Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34Unverified
6IP-SLTBLEU-416.72Unverified
7ConSLTBLEU-414.53Unverified
8BN-TIN-Transf.BLEU-413.19Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14Unverified