SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 153 papers

TitleStatusHype
Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translation—0
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods—0
Stream State-tying for Sign Language Recognition—0
CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal CorrelationCode1
LLMs are Good Sign Language Translators—0
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language TranslationCode1
Using an LLM to Turn Sign Spottings into Spoken Language Sentences—0
Mediapi-RGB: Enabling Technological Breakthroughs in French Sign Language (LSF) Research through an Extensive Video-Text CorpusCode0
Towards Privacy-Aware Sign Language Translation at ScaleCode1
Unsupervised Sign Language Translation and Generation—0
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions—0
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars—0
Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal AlignmentCode1
VK-G2T: Vision and Context Knowledge enhanced Gloss2Text—0
Fingerspelling PoseNet: Enhancing Fingerspelling Translation with Pose-Based Transformer ModelsCode0
JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language ProcessingCode0
sign.mt: Real-Time Multilingual Sign Language Translation Application—0
A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset—0
SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language ModelsCode1
Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation—0
Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods—0
Sign Language Translation with Iterative Prototype—0
Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse—0
Gloss-free Sign Language Translation: Improving from Visual-Language PretrainingCode1
Gloss Attention for Gloss-free Sign Language TranslationCode1
ISLTranslate: Dataset for Translating Indian Sign LanguageCode1
A two-way translation system of Chinese sign language based on computer vision—0
An Open-Source Gloss-Based Baseline for Spoken to Signed Language TranslationCode1
Gloss-Free End-to-End Sign Language TranslationCode1
Cross-modality Data Augmentation for End-to-End Sign Language TranslationCode1
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding—0
A Comparative Analysis of Techniques and Algorithms for Recognising Sign Language—0
SLTUNET: A Simple Unified Model for Sign Language TranslationCode1
Better Sign Language Translation with Monolingual DataCode0
Sign Language Translation from Instructional VideosCode1
A comparison of small sample methods for Handshape RecognitionCode0
Spatio-temporal Sign Language Representation and Translation—0
SignNet: Single Channel Sign Generation using Metric Embedded Learning—0
Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22Code0
Considerations for meaningful sign language machine translation based on glosses—0
LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language TranslationCode1
Two-Stream Network for Sign Language Recognition and Translation—0
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation—0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
Machine Translation between Spoken Languages and Signed Languages Represented in SignWritingCode1
Changing the Representation: Examining Language Representation for Neural Sign Language Production—0
Building Korean Sign Language Augmentation (KoSLA) Corpus with Data Augmentation Technique—0
Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool—0
KoSign Sign Language Translation Project: Introducing The NIASL2021 Dataset—0
Automatic Gloss-level Data Augmentation for Sign Language Translation—0
Show:102550
← PrevPage 2 of 4Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified