SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 153 papers

TitleStatusHype
SignNet: Single Channel Sign Generation using Metric Embedded Learning—0
Tackling Low-Resourced Sign Language Translation: UPC at WMT-SLT 22Code0
Considerations for meaningful sign language machine translation based on glosses—0
Two-Stream Network for Sign Language Recognition and TranslationCode0
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation—0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
Changing the Representation: Examining Language Representation for Neural Sign Language Production—0
Building Korean Sign Language Augmentation (KoSLA) Corpus with Data Augmentation Technique—0
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words—0
Automatic Gloss-level Data Augmentation for Sign Language Translation—0
Towards Large Vocabulary Kazakh-Russian Sign Language Dataset: KRSL-OnlineSchool—0
KoSign Sign Language Translation Project: Introducing The NIASL2021 Dataset—0
Sign Language Translation: Ongoing Development, Challenges and Innovations in the SignON Project—0
Prior Knowledge and Memory Enriched Transformer for Sign Language Translation—0
Keypoint based Sign Language Translation without Glosses—0
A Token-level Contrastive Framework for Sign Language TranslationCode0
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges—0
All You Need In Sign Language Production—0
MLSLT: Towards Multilingual Sign Language Translation—0
SimulSLT: End-to-End Simultaneous Sign Language Translation—0
End-To-End Sign Language Translation via Multitask Learning—0
Sign Language Translation with Hierarchical Spatio-TemporalGraph Neural Network—0
BBC-Oxford British Sign Language Dataset—0
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task—0
AVASAG: A German Sign Language Translation System for Public Services (short paper)—0
Sign Language Translation in a Healthcare Setting—0
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation—0
Data Augmentation for Sign Language Gloss Translation—0
Content4All Open Research Sign Language Translation Datasets—0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation—0
Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network—0
Efficient sign language recognition system and dataset creation method based on deep learning and image processing—0
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation—0
Master Thesis: Neural Sign Language Translation by Learning Tokenization—0
Score-level Multi Cue Fusion for Sign Language Recognition—0
Multi-channel Transformers for Multi-articulatory Sign Language Translation—0
Optimised Preprocessing for Automatic Mouth Gesture Classification—0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs—0
ASL Recognition with Metric-Learning based Lightweight NetworkCode0
Neural Sign Language Translation by Learning Tokenization—0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks—0
Sequence-to-Sequence Natural Language to Humanoid Robot Sign Language—0
Neural Sign Language Translation based on Human Keypoint Estimation—0
Connectionist Temporal Fusion for Sign Language Translation—0
Neural Sign Language TranslationCode0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation—0
Sign Language Recognition Using Temporal Classification—0
An Open Web Platform for Rule-Based Speech-to-Sign Translation—0
Helping Domain Experts Build Speech Translation Systems—0
Bridging the gap between sign language machine translation and sign language animation using sequence classification—0
Show:102550
← PrevPage 3 of 4Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified