SOTAVerified

Sign Language Recognition

Sign Language Recognition is a computer vision and natural language processing task that involves automatically recognizing and translating sign language gestures into written or spoken language. The goal of sign language recognition is to develop algorithms that can understand and interpret sign language, enabling people who use sign language as their primary mode of communication to communicate more easily with non-signers.

( Image credit: Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison )

Papers

Showing 201250 of 297 papers

TitleStatusHype
TSLFormer: A Lightweight Transformer Model for Turkish Sign Language Recognition Using Skeletal Landmarks0
Two-stream Fusion Model for Dynamic Hand Gesture Recognition using 3D-CNN and 2D-CNN Optical Flow guided Motion Template0
A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production0
Unsupervised Feature Learning for Visual Sign Language Identification0
Unsupervised Term Discovery for Continuous Sign Language0
Un syst\`eme de segmentation automatique de gestes appliqu\'e \`a la Langue des Signes (An automatic gesture segmentation system applied to Sign Language) [in French]0
Using Motion History Images with 3D Convolutional Networks in Isolated Sign Language Recognition0
Video-based Sign Language Recognition without Temporal Segmentation0
Visual Methods for Sign Language Recognition: A Modality-Based Review0
Visual Speech Recognition0
VSNet: Focusing on the Linguistic Characteristics of Sign Language0
Word-level Sign Language Recognition with Multi-stream Neural Networks Focusing on Local Regions and Skeletal Information0
Word separation in continuous sign language using isolated signs and post-processing0
Zero-Shot Sign Language Recognition: Can Textual Data Uncover Sign Languages?0
Word level Bangla Sign Language Dataset for Continuous BSL Recognition0
Multi-View Spatial-Temporal Network for Continuous Sign Language Recognition0
OLMD: Orientation-aware Long-term Motion Decoupling for Continuous Sign Language Recognition0
One Model is Not Enough: Ensembles for Isolated Sign Language Recognition0
On the Importance of Signer Overlap for Sign Language Detection0
Optimization of Transfer Learning for Sign Language Recognition Targeting Mobile Platform0
PenSLR: Persian end-to-end Sign Language Recognition Using Ensembling0
PeruSIL: A Framework to Build a Continuous Peruvian Sign Language Interpretation Dataset0
PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution0
Pixel-Level Hand Detection in Ego-centric Videos0
Pose-based Sign Language Recognition using GCN and BERT0
Read and Attend: Temporal Localisation in Sign Language Videos0
Real-Time and Robust Method for Hand Gesture Recognition System Based on Cross-Correlation Coefficient0
Real-time Sign Language Recognition Using MobileNetV2 and Transfer Learning0
Reasoning about Body-Parts Relations for Sign Language Recognition0
Recognition of Indian Sign Language in Live Video0
Recognition of Nonmanual Markers in American Sign Language (ASL) Using Non-Parametric Adaptive 2D-3D Face Tracking0
Recurrent Convolutional Neural Networks for Continuous Sign Language Recognition by Staged Optimization0
Representing Signs as Signs: One-Shot ISLR to Facilitate Functional Sign Language Technologies0
Re-Sign: Re-Aligned End-To-End Sequence Modelling With Deep Recurrent CNN-HMMs0
Revolutionizing Communication with Deep Learning and XAI for Enhanced Arabic Sign Language Recognition0
RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video0
Robust Feature Extraction to Utterance Fluctuation of Articulation Disorders Based on Random Projection0
RWTH-PHOENIX-Weather: A Large Vocabulary Sign Language Recognition and Translation Corpus0
Scaling up Multimodal Pre-training for Sign Language Understanding0
Score-level Multi Cue Fusion for Sign Language Recognition0
Self-Sufficient Framework for Continuous Sign Language Recognition0
Self-Supervised Video Transformers for Isolated Sign Language Recognition0
Sentence-Level Sign Language Recognition Framework0
SF-Net: Structured Feature Network for Continuous Sign Language Recognition0
SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction0
SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmark0
SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding0
SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition0
Sign Language Conversation Interpretation Using Wearable Sensors and Machine Learning0
LSFB-CONT and LSFB-ISOL: Two New Datasets for Vision-Based Sign Language RecognitionCode0
Show:102550
← PrevPage 5 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SubUNetsWord Error Rate (WER)40.7Unverified
2CTF-MMWord Error Rate (WER)37.8Unverified
3DTNWord Error Rate (WER)36.5Unverified
4SANWord Error Rate (WER)29.7Unverified
5Stochastic CSLRWord Error Rate (WER)25.3Unverified
6CrossModalWord Error Rate (WER)24Unverified
7SLRGANWord Error Rate (WER)23.4Unverified
8DNFWord Error Rate (WER)22.86Unverified
9VACWord Error Rate (WER)22.1Unverified
10MSKA-SLRWord Error Rate (WER)22.1Unverified
#ModelMetricClaimedVerifiedStatus
1Stochastic CSLRWord Error Rate (WER)26.1Unverified
2CrossModalWord Error Rate (WER)24.3Unverified
3SignBTWord Error Rate (WER)23.9Unverified
4MMTLBWord Error Rate (WER)22.45Unverified
5SMKDWord Error Rate (WER)22.4Unverified
6STMCWord Error Rate (WER)21Unverified
7WRNN + LETWord Error Rate (WER)20.73Unverified
8MSKA-SLRWord Error Rate (WER)20.5Unverified
9C2SLRWord Error Rate (WER)20.4Unverified
10SignBERT+Word Error Rate (WER)19.9Unverified
#ModelMetricClaimedVerifiedStatus
1BN-TIN+Transf.Word Error Rate (WER)33.1Unverified
2C2SLRWord Error Rate (WER)31Unverified
3SENWord Error Rate (WER)30.7Unverified
4AdaBrowseWord Error Rate (WER)30.6Unverified
5CorrNetWord Error Rate (WER)30.1Unverified
6CTCAWord Error Rate (WER)29.4Unverified
7TCNetWord Error Rate (WER)29.3Unverified
8CorrNet+ACDRWord Error Rate (WER)29Unverified
9MSKA-SLRWord Error Rate (WER)27.8Unverified
10Swin-MSTPWord Error Rate (WER)27.1Unverified
#ModelMetricClaimedVerifiedStatus
1STF+LSTMRank-1 Recognition Rate0.99Unverified
2SAM-SLR (RGB-D)Rank-1 Recognition Rate0.99Unverified
33D-DCNN + ST-MGCNRank-1 Recognition Rate0.98Unverified
4Ensemble - NTISRank-1 Recognition Rate0.96Unverified
5HWGATRank-1 Recognition Rate0.96Unverified
6MViT-SLRRank-1 Recognition Rate0.96Unverified
7FE+LSTMRank-1 Recognition Rate0.93Unverified
8VTN-PFRank-1 Recognition Rate0.93Unverified
9CNN+FPM+BLSTM+Attention (RGB-D)Rank-1 Recognition Rate0.62Unverified
#ModelMetricClaimedVerifiedStatus
1Logos-PretrainingTop-1 Accuracy66.82Unverified
2Uni-SignTop-1 Accuracy63.52Unverified
3NLA-SLRTop-1 Accuracy61.26Unverified
4StepNetTop-1 Accuracy61.17Unverified
5SAM-SLRTop-1 Accuracy58.73Unverified
6SWIN-SLRTop-1 Accuracy58.51Unverified
7HWGATTop-1 Accuracy48.49Unverified
8I3D (pretraining: BSL-1K)Top-1 Accuracy46.82Unverified
9I3DTop-1 Accuracy32.48Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SignTop-1 Accuracy92.25Unverified
2SiformerTop-1 Accuracy86.5Unverified
3SignBERTTop-1 Accuracy83.3Unverified
4I3D, ST-GCNTop-1 Accuracy81.38Unverified
5StepNetTop-1 Accuracy78.29Unverified
6I3DTop-1 Accuracy65.89Unverified
7SPOTERTop-1 Accuracy63.18Unverified
#ModelMetricClaimedVerifiedStatus
1HandReader_RGBCER (%)30.7Unverified
2HandReader_KPCER (%)28Unverified
3HandReader_RGBCER (%)27.6Unverified
4HandReader_RGB_KPCER (%)27.1Unverified
5HandReader_KPCER (%)26.2Unverified
6HandReader_RGB+KPCER (%)24.4Unverified
#ModelMetricClaimedVerifiedStatus
1SPOTERAccuracy (%)100Unverified
2SiformerAccuracy (%)99.84Unverified
3HWGATAccuracy (%)98.59Unverified
4Bag of words fusion of hand pose/movement/positionAccuracy (%)97Unverified
53DGCNAccuracy (%)94.84Unverified
#ModelMetricClaimedVerifiedStatus
1HandReader_RGBCER (%)7.61Unverified
2HandReader_KPCER (%)7.35Unverified
3HandReader_RGB_KPCER (%)5.06Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SignP-I Top-1 Accuracy78.16Unverified
2SignBERT+P-I Top-1 Accuracy73.71Unverified
#ModelMetricClaimedVerifiedStatus
1StepNetTop-1 Accuracy61.17Unverified
2SignBERT+Top-1 Accuracy55.59Unverified
#ModelMetricClaimedVerifiedStatus
1StepNetActions Top-177.1Unverified
#ModelMetricClaimedVerifiedStatus
1MobileNetV2_TSMAccuracy (Top-1)83.6Unverified
#ModelMetricClaimedVerifiedStatus
1HWGATTop-1 Accuracy93.86Unverified
#ModelMetricClaimedVerifiedStatus
13D-DCNN + ST-MGCNRank-1 Recognition Rate0.98Unverified
#ModelMetricClaimedVerifiedStatus
1Skeleton Image RepresentationAccuracy82Unverified
#ModelMetricClaimedVerifiedStatus
1Skeleton Image RepresentationAccuracy93Unverified
#ModelMetricClaimedVerifiedStatus
1mVITv2-SMean Accuracy64.09Unverified