Sign Language Translation

Given a video containing sign language, the task is to predict the translation into (written) spoken language.

Image credit: How2Sign

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 126–150 of 153 papers

Title	Date	Tasks	Status	Hype
Continuous Sign Language Recognition through a Context-Aware Generative Adversarial Network	Apr 1, 2021	Generative Adversarial NetworkSentence	—Unverified	0
Efficient sign language recognition system and dataset creation method based on deep learning and image processing	Mar 22, 2021	Data Augmentationobject-detection	—Unverified	0
Variational Bayesian Sequence-to-Sequence Networks for Memory-Efficient Sign Language Translation	Feb 11, 2021	Sign Language TranslationTranslation	—Unverified	0
Master Thesis: Neural Sign Language Translation by Learning Tokenization	Nov 18, 2020	Domain AdaptationMachine Translation	—Unverified	0
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation	Oct 12, 2020	Sign Language RecognitionSign Language Translation	CodeCode Available	2
Score-level Multi Cue Fusion for Sign Language Recognition	Sep 29, 2020	Sign Language RecognitionSign Language Translation	—Unverified	0
Multi-channel Transformers for Multi-articulatory Sign Language Translation	Sep 1, 2020	Sign Language TranslationTranslation	—Unverified	0
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language	Aug 18, 2020	Sign Language ProductionSign Language Translation	CodeCode Available	1
Optimised Preprocessing for Automatic Mouth Gesture Classification	May 1, 2020	ClassificationGeneral Classification	—Unverified	0
Convolutional Neural Network Array for Sign Language Recognition using Wearable IMUs	Apr 21, 2020	Gesture RecognitionSentence	—Unverified	0
ASL Recognition with Metric-Learning based Lightweight Network	Apr 10, 2020	Action RecognitionAutonomous Driving	CodeCode Available	0
Better Sign Language Translation with STMC-Transformer	Apr 1, 2020	Sign Language RecognitionSign Language Translation	CodeCode Available	1
Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation	Mar 30, 2020	Sign Language RecognitionSign Language Translation	CodeCode Available	1
Neural Sign Language Translation by Learning Tokenization	Feb 2, 2020	Sign Language TranslationTransfer Learning	—Unverified	0
Text2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks	Jan 2, 2020	Generative Adversarial NetworkMachine Translation	—Unverified	0
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison	Oct 24, 2019	Action ClassificationBenchmarking	CodeCode Available	1
Sequence-to-Sequence Natural Language to Humanoid Robot Sign Language	Jul 9, 2019	Sign Language TranslationTranslation	—Unverified	0
Neural Sign Language Translation based on Human Keypoint Estimation	Nov 28, 2018	Keypoint EstimationSign Language Translation	—Unverified	0
Connectionist Temporal Fusion for Sign Language Translation	Oct 1, 2018	SentenceSign Language Recognition	—Unverified	0
Neural Sign Language Translation	Jun 1, 2018	Gesture RecognitionLanguage Modeling	CodeCode Available	0
DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translation	Feb 21, 2018	SentenceSign Language Translation	—Unverified	0
Sign Language Recognition Using Temporal Classification	Jan 7, 2017	ClassificationGeneral Classification	—Unverified	0
An Open Web Platform for Rule-Based Speech-to-Sign Translation	Aug 1, 2016	Machine TranslationSign Language Recognition	—Unverified	0
Helping Domain Experts Build Speech Translation Systems	Oct 7, 2015	Sign Language TranslationTranslation	—Unverified	0
Coupling Natural Language Processing and Animation Synthesis in Portuguese Sign Language Translation	Sep 1, 2015	Sign Language RecognitionSign Language Translation	—Unverified	0

Show:10 25 50

← PrevPage 6 of 7Next →

All datasets RWTH-PHOENIX-Weather 2014 T CSL-Daily ASLG-PC12 How2Sign LSA-T Mediapi-RGB

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	MSKA-SLT	BLEU-4	29.03	—	Unverified
2	TwoStream-SLT	BLEU-4	28.95	—	Unverified
3	SignBERT+	BLEU-4	25.7	—	Unverified
4	S2T Stochastic Transformer (Ens)	BLEU-4	25.59	—	Unverified
5	STMC+Transformer (Ens)	BLEU-4	25.4	—	Unverified
6	BN-TIN-Transf.+SignBT	BLEU-4	24.32	—	Unverified
7	Signformer	BLEU-4	23.43	—	Unverified
8	BERT2RND	BLEU-4	22.47	—	Unverified
9	BN-TIN-Transf.	BLEU-4	21.68	—	Unverified
10	BERT2BERT	BLEU-4	21.26	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	TwoStream-SLT	BLEU-4	25.79	—	Unverified
2	MSKA-SLT	BLEU-4	25.52	—	Unverified
3	MMTLB	BLEU-4	23.92	—	Unverified
4	XmDA	BLEU-4	21.58	—	Unverified
5	BN-TIN-Transf.+SignBT	BLEU-4	21.34	—	Unverified
6	IP-SLT	BLEU-4	16.72	—	Unverified
7	ConSLT	BLEU-4	14.53	—	Unverified
8	BN-TIN-Transf.	BLEU-4	13.19	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Transformer Ens.	BLEU-4	82.87	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1		BLEU	8.03	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Keypoints-Transformer-UNLP	Word Error Rate (WER)	0.94	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	Transformer Baseline	BLEU-4	4.14	—	Unverified