SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Showing 76100 of 153 papers

TitleStatusHype
SignBLEU: Automatic Evaluation of Multi-channel Sign Language TranslationCode0
Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation0
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods0
Stream State-tying for Sign Language Recognition0
LLMs are Good Sign Language Translators0
Using an LLM to Turn Sign Spottings into Spoken Language Sentences0
Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research through an Extensive Video-Text CorpusCode0
Unsupervised Sign Language Translation and Generation0
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions0
A Simple Baseline for Spoken Language to Sign Language Translation with 3D AvatarsCode0
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text0
Fingerspelling PoseNet: Enhancing Fingerspelling Translation with Pose-Based Transformer ModelsCode0
JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language ProcessingCode0
sign.mt: Real-Time Multilingual Sign Language Translation Application0
A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset0
Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation0
Sign Language Translation with Iterative Prototype0
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods0
Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse0
A two-way translation system of Chinese sign language based on computer vision0
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding0
A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language0
Better Sign Language Translation with Monolingual DataCode0
A comparison of small sample methods for Handshape RecognitionCode0
Spatio-temporal Sign Language Representation and Translation0
Show:102550
← PrevPage 4 of 7Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03Unverified
2TwoStream-SLTBLEU-428.95Unverified
3SignBERT+BLEU-425.7Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59Unverified
5STMC+Transformer (Ens)BLEU-425.4Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32Unverified
7SignformerBLEU-423.43Unverified
8BERT2RNDBLEU-422.47Unverified
9BN-TIN-Transf.BLEU-421.68Unverified
10BERT2BERTBLEU-421.26Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79Unverified
2MSKA-SLTBLEU-425.52Unverified
3MMTLBBLEU-423.92Unverified
4XmDABLEU-421.58Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34Unverified
6IP-SLTBLEU-416.72Unverified
7ConSLTBLEU-414.53Unverified
8BN-TIN-Transf.BLEU-413.19Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14Unverified