SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 153 papers

TitleStatusHype
Sign Language Production With Avatar Layering: A Critical Use Case over Rare Words—0
Sign Language Translation: Ongoing Development, Challenges and Innovations in the SignON Project—0
Open-Domain Sign Language Translation Learned from Online VideoCode1
Using Neural Machine Translation Methods for Sign Language TranslationCode1
Prior Knowledge and Memory Enriched Transformer for Sign Language Translation—0
Keypoint based Sign Language Translation without Glosses—0
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data AugmentationCode1
A Token-level Contrastive Framework for Sign Language TranslationCode0
A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationCode1
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges—0
All You Need In Sign Language Production—0
MLSLT: Towards Multilingual Sign Language Translation—0
SimulSLT: End-to-End Simultaneous Sign Language Translation—0
End-To-End Sign Language Translation via Multitask Learning—0
Sign Language Translation with Hierarchical Spatio-TemporalGraph Neural Network—0
BBC-Oxford British Sign Language Dataset—0
Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL TranslationCode1
Frozen Pretrained Transformers for Neural Sign Language TranslationCode1
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task—0
AVASAG: A German Sign Language Translation System for Public Services (short paper)—0
Sign Language Translation in a Healthcare Setting—0
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation—0
Data Augmentation for Sign Language Gloss Translation—0
Content4All Open Research Sign Language Translation Datasets—0
Skeletor: Skeletal Transformers for Robust Body-Pose Estimation—0
Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network—0
Efficient sign language recognition system and dataset creation method based on deep learning and image processing—0
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation—0
Master Thesis: Neural Sign Language Translation by Learning Tokenization—0
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language TranslationCode2
Score-level Multi Cue Fusion for Sign Language Recognition—0
Multi-channel Transformers for Multi-articulatory Sign Language Translation—0
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign LanguageCode1
Optimised Preprocessing for Automatic Mouth Gesture Classification—0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs—0
ASL Recognition with Metric-Learning based Lightweight NetworkCode0
Better Sign Language Translation with STMC-TransformerCode1
Sign Language Transformers: Joint End-to-end Sign Language Recognition and TranslationCode1
Neural Sign Language Translation by Learning Tokenization—0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks—0
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods ComparisonCode1
Sequence-to-Sequence Natural Language to Humanoid Robot Sign Language—0
Neural Sign Language Translation based on Human Keypoint Estimation—0
Connectionist Temporal Fusion for Sign Language Translation—0
Neural Sign Language TranslationCode0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation—0
Sign Language Recognition Using Temporal Classification—0
An Open Web Platform for Rule-Based Speech-to-Sign Translation—0
Helping Domain Experts Build Speech Translation Systems—0
Coupling Natural Language Processing and Animation Synthesis in Portuguese Sign Language Translation—0
Show:102550
← PrevPage 3 of 4Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified