SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–25 of 153 papers

TitleStatusHype
Speak2Sign3D: A Multi-modal Pipeline for English Speech to American Sign Language Animation—0
Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language TranslationCode1
Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation ModelCode0
Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation—0
ADAT: Time-Series-Aware Adaptive Transformer Architecture for Sign Language Translation—0
Hands-On: Segmenting Individual Signs from Continuous Sequences—0
A multitask transformer to sign language translation using motion gesture primitives—0
Sign Language Translation using Frame and Event Stream: Benchmark Dataset and AlgorithmsCode1
Spatio-temporal transformer to support automatic sign language translation—0
Uni-Sign: Toward Unified Sign Language Understanding at ScaleCode2
Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues—0
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility—0
Learning Sign Language Representation using CNN LSTM, 3DCNN, CNN RNN LSTM and CCN TD—0
Real-time Bangla Sign Language TranslatorCode0
LLaVA-SLT: Visual Language Tuning for Sign Language Translation—0
Improvement in Sign Language Translation Using Text CTC AlignmentCode0
Real-Time Multilingual Sign Language Processing—0
Signs as Tokens: An Autoregressive Multilingual Sign Language Generator—0
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model—0
Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation—0
SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction—0
Signformer is all you need: Towards Edge AI for Sign LanguageCode1
Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs—0
Diverse Sign Language TranslationCode0
SignAttention: On the Interpretability of Transformer Models for Sign Language TranslationCode0
Show:102550
← PrevPage 1 of 7Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified