SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 153 papers

TitleStatusHype
Uni-Sign: Toward Unified Sign Language Understanding at ScaleCode2
An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval InterfaceCode2
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language TranslationCode2
Gloss-Free End-to-End Sign Language TranslationCode1
Sign Language Transformers: Joint End-to-end Sign Language Recognition and TranslationCode1
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign LanguageCode1
Towards Privacy-Aware Sign Language Translation at ScaleCode1
ISLTranslate: Dataset for Translating Indian Sign LanguageCode1
Signformer is all you need: Towards Edge AI for Sign LanguageCode1
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL TranslationCode1
Using Neural Machine Translation Methods for Sign Language TranslationCode1
Sign Language Translation using Frame and Event Stream: Benchmark Dataset and AlgorithmsCode1
Cross-modality Data Augmentation for End-to-End Sign Language TranslationCode1
CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal CorrelationCode1
Frozen Pretrained Transformers for Neural Sign Language TranslationCode1
Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal AlignmentCode1
Gloss-free Sign Language Translation: Improving from Visual-Language PretrainingCode1
Improving Gloss-free Sign Language Translation by Reducing Representation DensityCode1
Multi-Stream Keypoint Attention Network for Sign Language Recognition and TranslationCode1
SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language ModelsCode1
Sign Language Translation from Instructional VideosCode1
SLTUNET: A Simple Unified Model for Sign Language TranslationCode1
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language TranslationCode1
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods ComparisonCode1
Event Stream based Sign Language Translation: A High-Definition Benchmark Dataset and A New AlgorithmCode1
Better Sign Language Translation with STMC-TransformerCode1
An Open-Source Gloss-Based Baseline for Spoken to Signed Language TranslationCode1
Open-Domain Sign Language Translation Learned from Online VideoCode1
Machine Translation between Spoken Languages and Signed Languages Represented in SignWritingCode1
Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language TranslationCode1
LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language TranslationCode1
An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMsCode1
A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationCode1
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data AugmentationCode1
Gloss Attention for Gloss-free Sign Language TranslationCode1
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions—0
A prototype Malayalam to Sign Language Automatic Translator—0
Changing the Representation: Examining Language Representation for Neural Sign Language Production—0
C^2RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval—0
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task—0
A multitask transformer to sign language translation using motion gesture primitives—0
Building Korean Sign Language Augmentation (KoSLA) Corpus with Data Augmentation Technique—0
Bridging the gap between sign language machine translation and sign language animation using sequence classification—0
A platform-independent user-friendly dictionary from Italian to LIS—0
Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs—0
Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation—0
End-To-End Sign Language Translation via Multitask Learning—0
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing—0
An Open Web Platform for Rule-Based Speech-to-Sign Translation—0
Show:102550
← PrevPage 1 of 4Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified