SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Showing 5175 of 153 papers

TitleStatusHype
SignAttention: On the Interpretability of Transformer Models for Sign Language TranslationCode0
A Token-level Contrastive Framework for Sign Language TranslationCode0
JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language ProcessingCode0
Less is more: concatenating videos for Sign Language Translation from a small set of signsCode0
Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label SmoothingCode0
A Simple Baseline for Spoken Language to Sign Language Translation with 3D AvatarsCode0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation0
FSboard: Over 3 million characters of ASL fingerspelling collected via smartphones0
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions0
A prototype Malayalam to Sign Language Automatic Translator0
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation0
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility0
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation0
Changing the Representation: Examining Language Representation for Neural Sign Language Production0
Fingerspelling within Sign Language Translation0
C^2RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval0
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task0
A multitask transformer to sign language translation using motion gesture primitives0
Building Korean Sign Language Augmentation (KoSLA) Corpus with Data Augmentation Technique0
EvSign: Sign Language Recognition and Translation with Streaming Events0
Bridging the gap between sign language machine translation and sign language animation using sequence classification0
A platform-independent user-friendly dictionary from Italian to LIS0
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods0
Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs0
End-To-End Sign Language Translation via Multitask Learning0
Show:102550
← PrevPage 3 of 7Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03Unverified
2TwoStream-SLTBLEU-428.95Unverified
3SignBERT+BLEU-425.7Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59Unverified
5STMC+Transformer (Ens)BLEU-425.4Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32Unverified
7SignformerBLEU-423.43Unverified
8BERT2RNDBLEU-422.47Unverified
9BN-TIN-Transf.BLEU-421.68Unverified
10BERT2BERTBLEU-421.26Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79Unverified
2MSKA-SLTBLEU-425.52Unverified
3MMTLBBLEU-423.92Unverified
4XmDABLEU-421.58Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34Unverified
6IP-SLTBLEU-416.72Unverified
7ConSLTBLEU-414.53Unverified
8BN-TIN-Transf.BLEU-413.19Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14Unverified