SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Showing 51100 of 153 papers

TitleStatusHype
ASL Recognition with Metric-Learning based Lightweight NetworkCode0
Real-time Bangla Sign Language TranslatorCode0
Better Sign Language Translation with Monolingual DataCode0
A comparison of small sample methods for Handshape RecognitionCode0
Sign Language Translation with Sentence Embedding SupervisionCode0
Two-Stream Network for Sign Language Recognition and TranslationCode0
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges0
Master Thesis: Neural Sign Language Translation by Learning Tokenization0
MLSLT: Towards Multilingual Sign Language Translation0
Multi-channel Transformers for Multi-articulatory Sign Language Translation0
Neural Sign Language Translation based on Human Keypoint Estimation0
Neural Sign Language Translation by Learning Tokenization0
Optimised Preprocessing for Automatic Mouth Gesture Classification0
Prior Knowledge and Memory Enriched Transformer for Sign Language Translation0
Real-Time Multilingual Sign Language Processing0
Reconsidering Sentence-Level Sign Language Translation0
Scaling Sign Language Translation0
Scaling up Multimodal Pre-training for Sign Language Understanding0
Score-level Multi Cue Fusion for Sign Language Recognition0
Sequence-to-Sequence Natural Language to Humanoid Robot Sign Language0
SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction0
Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation0
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding0
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words0
Sign Language Recognition Using Temporal Classification0
Sign Language Translation in a Healthcare Setting0
Sign Language Translation: Ongoing Development, Challenges and Innovations in the SignON Project0
Sign Language Translation with Hierarchical Spatio-TemporalGraph Neural Network0
Sign Language Translation with Iterative Prototype0
sign.mt: Real-Time Multilingual Sign Language Translation Application0
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale0
SignNet: Single Channel Sign Generation using Metric Embedded Learning0
Signs as Tokens: An Autoregressive Multilingual Sign Language Generator0
SimulSLT: End-to-End Simultaneous Sign Language Translation0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation0
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services0
Spatio-temporal transformer to support automatic sign language translation0
Speak2Sign3D: A Multi-modal Pipeline for English Speech to American Sign Language Animation0
Stream State-tying for Sign Language Recognition0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks0
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods0
Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool0
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production0
Unsupervised Sign Language Translation and Generation0
Using an LLM to Turn Sign Spottings into Spoken Language Sentences0
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation0
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text0
Spatio-temporal Sign Language Representation and Translation0
A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language0
ADAT: Time-Series-Aware Adaptive Transformer Architecture for Sign Language Translation0
Show:102550
← PrevPage 2 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03Unverified
2TwoStream-SLTBLEU-428.95Unverified
3SignBERT+BLEU-425.7Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59Unverified
5STMC+Transformer (Ens)BLEU-425.4Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32Unverified
7SignformerBLEU-423.43Unverified
8BERT2RNDBLEU-422.47Unverified
9BN-TIN-Transf.BLEU-421.68Unverified
10BERT2BERTBLEU-421.26Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79Unverified
2MSKA-SLTBLEU-425.52Unverified
3MMTLBBLEU-423.92Unverified
4XmDABLEU-421.58Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34Unverified
6IP-SLTBLEU-416.72Unverified
7ConSLTBLEU-414.53Unverified
8BN-TIN-Transf.BLEU-413.19Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14Unverified