SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 126–150 of 153 papers

TitleStatusHype
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation—0
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text—0
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding—0
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words—0
Sign Language Recognition Using Temporal Classification—0
Sign Language Translation in a Healthcare Setting—0
Sign Language Translation: Ongoing Development, Challenges and Innovations in the SignON Project—0
Sign Language Translation with Hierarchical Spatio-TemporalGraph Neural Network—0
Sign Language Translation with Iterative Prototype—0
sign.mt: Real-Time Multilingual Sign Language Translation Application—0
SignAttention: On the Interpretability of Transformer Models for Sign Language TranslationCode0
Real-time Bangla Sign Language TranslatorCode0
Fingerspelling PoseNet: Enhancing Fingerspelling Translation with Pose-Based Transformer ModelsCode0
SignBLEU: Automatic Evaluation of Multi-channel Sign Language TranslationCode0
Neural Sign Language TranslationCode0
Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label SmoothingCode0
Diverse Sign Language TranslationCode0
Sign Language Sense DisambiguationCode0
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation ModelCode0
Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research through an Extensive Video-Text CorpusCode0
Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22Code0
Better Sign Language Translation with Monolingual DataCode0
Less is more: concatenating videos for Sign Language Translation from a small set of signsCode0
Improvement in Sign Language Translation Using Text CTC AlignmentCode0
A Token-level Contrastive Framework for Sign Language TranslationCode0
Show:102550
← PrevPage 6 of 7Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified