SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 153 papers

TitleStatusHype
All You Need In Sign Language Production—0
American Sign Language to Text Translation using Transformer and Seq2Seq with LSTM—0
A multitask transformer to sign language translation using motion gesture primitives—0
A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset—0
An Open Web Platform for Rule-Based Speech-to-Sign Translation—0
A platform-independent user-friendly dictionary from Italian to LIS—0
Approaching Sign Language Gloss Translation as a Low-Resource Machine Translation Task—0
A prototype Malayalam to Sign Language Automatic Translator—0
Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation—0
A two-way translation system of Chinese sign language based on computer vision—0
Automatic Gloss-level Data Augmentation for Sign Language Translation—0
AVASAG: A German Sign Language Translation System for Public Services (short paper)—0
BBC-Oxford British Sign Language Dataset—0
Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translation—0
Bridging the gap between sign language machine translation and sign language animation using sequence classification—0
Building Korean Sign Language Augmentation (KoSLA) Corpus with Data Augmentation Technique—0
C^2RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval—0
Changing the Representation: Examining Language Representation for Neural Sign Language Production—0
ChatGPT, Let us Chat Sign Language: Experiments, Architectural Elements, Challenges and Research Directions—0
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation—0
Connectionist Temporal Fusion for Sign Language Translation—0
Considerations for meaningful sign language machine translation based on glosses—0
Content4All Open Research Sign Language Translation Datasets—0
Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network—0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs—0
Coupling Natural Language Processing and Animation Synthesis in Portuguese Sign Language Translation—0
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis—0
Data Augmentation for Sign Language Gloss Translation—0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation—0
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model—0
Efficient sign language recognition system and dataset creation method based on deep learning and image processing—0
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing—0
End-To-End Sign Language Translation via Multitask Learning—0
Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs—0
E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods—0
EvSign: Sign Language Recognition and Translation with Streaming Events—0
Fingerspelling within Sign Language Translation—0
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation—0
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation—0
FSboard: Over 3 million characters of ASL fingerspelling collected via smartphones—0
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility—0
Hands-On: Segmenting Individual Signs from Continuous Sequences—0
Helping Domain Experts Build Speech Translation Systems—0
Improving Sign Language Translation with Monolingual Data by Sign Back-Translation—0
Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse—0
Keypoint based Sign Language Translation without Glosses—0
KoSign Sign Language Translation Project: Introducing The NIASL2021 Dataset—0
Learning Sign Language Representation using CNN LSTM, 3DCNN, CNN RNN LSTM and CCN TD—0
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation—0
Leveraging the Power of MLLMs for Gloss-Free Sign Language Translation—0
Show:102550
← PrevPage 3 of 4Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified