SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 153 papers

TitleStatusHype
Considerations for meaningful sign language machine translation based on glosses—0
Content4All Open Research Sign Language Translation Datasets—0
Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network—0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs—0
Coupling Natural Language Processing and Animation Synthesis in Portuguese Sign Language Translation—0
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis—0
Data Augmentation for Sign Language Gloss Translation—0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation—0
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model—0
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale—0
SignNet: Single Channel Sign Generation using Metric Embedded Learning—0
Signs as Tokens: An Autoregressive Multilingual Sign Language Generator—0
SimulSLT: End-to-End Simultaneous Sign Language Translation—0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation—0
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services—0
Spatio-temporal transformer to support automatic sign language translation—0
Speak2Sign3D: A Multi-modal Pipeline for English Speech to American Sign Language Animation—0
Stream State-tying for Sign Language Recognition—0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks—0
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods—0
Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool—0
Two-Stream Network for Sign Language Recognition and Translation—0
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production—0
Unsupervised Sign Language Translation and Generation—0
Using an LLM to Turn Sign Spottings into Spoken Language Sentences—0
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation—0
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text—0
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding—0
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words—0
Sign Language Recognition Using Temporal Classification—0
Sign Language Translation in a Healthcare Setting—0
Sign Language Translation: Ongoing Development, Challenges and Innovations in the SignON Project—0
Sign Language Translation with Hierarchical Spatio-TemporalGraph Neural Network—0
Sign Language Translation with Iterative Prototype—0
sign.mt: Real-Time Multilingual Sign Language Translation Application—0
SignAttention: On the Interpretability of Transformer Models for Sign Language TranslationCode0
Real-time Bangla Sign Language TranslatorCode0
Fingerspelling PoseNet: Enhancing Fingerspelling Translation with Pose-Based Transformer ModelsCode0
SignBLEU: Automatic Evaluation of Multi-channel Sign Language TranslationCode0
Neural Sign Language TranslationCode0
Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label SmoothingCode0
Diverse Sign Language TranslationCode0
Sign Language Sense DisambiguationCode0
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation ModelCode0
Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research through an Extensive Video-Text CorpusCode0
Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22Code0
Better Sign Language Translation with Monolingual DataCode0
Less is more: concatenating videos for Sign Language Translation from a small set of signsCode0
Improvement in Sign Language Translation Using Text CTC AlignmentCode0
A Token-level Contrastive Framework for Sign Language TranslationCode0
Show:102550
← PrevPage 3 of 4Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified