SOTAVerified

Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 153 papers

TitleStatusHype
An Open Web Platform for Rule-Based Speech-to-Sign Translation—0
EvSign: Sign Language Recognition and Translation with Streaming Events—0
American Sign Language to Text Translation using Transformer and Seq2Seq with LSTM—0
1DCNNTrans: BISINDO Sign Language Interpreters in Improving the Inclusiveness of Public Services—0
C^2RL: Content and Context Representation Learning for Gloss-free Sign Language Translation and Retrieval—0
Fingerspelling within Sign Language Translation—0
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation—0
From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation—0
LLaVA-SLT: Visual Language Tuning for Sign Language Translation—0
FSboard: Over 3 million characters of ASL fingerspelling collected via smartphones—0
Efficient sign language recognition system and dataset creation method based on deep learning and image processing—0
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility—0
BBC-Oxford British Sign Language Dataset—0
AVASAG: A German Sign Language Translation System for Public Services (short paper)—0
DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model—0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation—0
All You Need In Sign Language Production—0
Data Augmentation for Sign Language Gloss Translation—0
Automatic Gloss-level Data Augmentation for Sign Language Translation—0
Cross-Attention Based Influence Model for Manual and Nonmanual Sign Language Analysis—0
Coupling Natural Language Processing and Animation Synthesis in Portuguese Sign Language Translation—0
A two-way translation system of Chinese sign language based on computer vision—0
Learning Sign Language Representation using CNN LSTM, 3DCNN, CNN RNN LSTM and CCN TD—0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs—0
Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation—0
Show:102550
← PrevPage 3 of 7Next →
All datasetsRWTH-PHOENIX-Weather 2014 TCSL-DailyASLG-PC12How2SignLSA-TMediapi-RGB

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MSKA-SLTBLEU-429.03—Unverified
2TwoStream-SLTBLEU-428.95—Unverified
3SignBERT+BLEU-425.7—Unverified
4S2T Stochastic Transformer (Ens)BLEU-425.59—Unverified
5STMC+Transformer (Ens)BLEU-425.4—Unverified
6BN-TIN-Transf.+SignBTBLEU-424.32—Unverified
7SignformerBLEU-423.43—Unverified
8BERT2RNDBLEU-422.47—Unverified
9BN-TIN-Transf.BLEU-421.68—Unverified
10BERT2BERTBLEU-421.26—Unverified
#ModelMetricClaimedVerifiedStatus
1TwoStream-SLTBLEU-425.79—Unverified
2MSKA-SLTBLEU-425.52—Unverified
3MMTLBBLEU-423.92—Unverified
4XmDABLEU-421.58—Unverified
5BN-TIN-Transf.+SignBTBLEU-421.34—Unverified
6IP-SLTBLEU-416.72—Unverified
7ConSLTBLEU-414.53—Unverified
8BN-TIN-Transf.BLEU-413.19—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer Ens.BLEU-482.87—Unverified
#ModelMetricClaimedVerifiedStatus
1BLEU8.03—Unverified
#ModelMetricClaimedVerifiedStatus
1Keypoints-Transformer-UNLPWord Error Rate (WER)0.94—Unverified
#ModelMetricClaimedVerifiedStatus
1Transformer BaselineBLEU-44.14—Unverified