SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Showing 101–125 of 153 papers

TitleStatusHype
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words—0
Sign Language Translation: Ongoing Development, Challenges and Innovations in the SignON Project—0
Open-Domain Sign Language Translation Learned from Online VideoCode1
Using Neural Machine Translation Methods for Sign Language TranslationCode1
Prior Knowledge and Memory Enriched Transformer for Sign Language Translation—0
Keypoint based Sign Language Translation without Glosses—0
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data AugmentationCode1
A Token-level Contrastive Framework for Sign Language TranslationCode0
A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationCode1
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges—0
All You Need In Sign Language Production—0
MLSLT: Towards Multilingual Sign Language Translation—0
SimulSLT: End-to-End Simultaneous Sign Language Translation—0
End-To-End Sign Language Translation via Multitask Learning—0
Sign Language Translation with Hierarchical Spatio-TemporalGraph Neural Network—0
BBC-Oxford British Sign Language Dataset—0
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL TranslationCode1
Frozen Pretrained Transformers for Neural Sign Language TranslationCode1
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task—0
AVASAG: A German Sign Language Translation System for Public Services (short paper)—0
Sign Language Translation in a Healthcare Setting—0
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation—0
Data Augmentation for Sign Language Gloss Translation—0
Content4All Open Research Sign Language Translation Datasets—0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation—0
Show:102550
← PrevPage 5 of 7Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified