SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 26–50 of 153 papers

TitleStatusHype
Better Sign Language Translation with STMC-TransformerCode1
An Open-Source Gloss-Based Baseline for Spoken to Signed Language TranslationCode1
Open-Domain Sign Language Translation Learned from Online VideoCode1
Machine Translation between Spoken Languages and Signed Languages Represented in SignWritingCode1
Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language TranslationCode1
LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language TranslationCode1
An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMsCode1
A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationCode1
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data AugmentationCode1
Gloss Attention for Gloss-free Sign Language TranslationCode1
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions—0
A prototype Malayalam to Sign Language Automatic Translator—0
Changing the Representation: Examining Language Representation for Neural Sign Language Production—0
C^2RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval—0
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task—0
A multitask transformer to sign language translation using motion gesture primitives—0
Building Korean Sign Language Augmentation (KoSLA) Corpus with Data Augmentation Technique—0
Bridging the gap between sign language machine translation and sign language animation using sequence classification—0
A platform-independent user-friendly dictionary from Italian to LIS—0
Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs—0
Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation—0
End-To-End Sign Language Translation via Multitask Learning—0
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing—0
An Open Web Platform for Rule-Based Speech-to-Sign Translation—0
Show:102550
← PrevPage 2 of 7Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified