SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 153 papers

TitleStatusHype
American Sign Language to Text Translation using Transformer and Seq2Seq with LSTM—0
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing—0
Sign Language Sense DisambiguationCode0
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis—0
Less is more: concatenating videos for Sign Language Translation from a small set of signsCode0
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services—0
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation—0
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation—0
An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMsCode1
Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New AlgorithmCode1
C^2RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval—0
An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval InterfaceCode2
Scaling up Multimodal Pre-training for Sign Language Understanding—0
Sign Language Translation with Sentence Embedding SupervisionCode0
Fingerspelling within Sign Language Translation—0
FSboard: Over 3 million characters of ASL fingerspelling collected via smartphones—0
EvSign: Sign Language Recognition and Translation with Streaming Events—0
Scaling Sign Language Translation—0
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production—0
Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label SmoothingCode0
Reconsidering Sentence-Level Sign Language Translation—0
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale—0
SignBLEU: Automatic Evaluation of Multi-channel Sign Language TranslationCode0
Improving Gloss-free Sign Language Translation by Reducing Representation DensityCode1
Multi-Stream Keypoint Attention Network for Sign Language Recognition and TranslationCode1
Show:102550
← PrevPage 2 of 7Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified