SOTAVerified

Sign Language Recognition

Sign Language Recognition is a computer vision and natural language processing task that involves automatically recognizing and translating sign language gestures into written or spoken language. The goal of sign language recognition is to develop algorithms that can understand and interpret sign language, enabling people who use sign language as their primary mode of communication to communicate more easily with non-signers.

( Image credit: Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison )

Papers

Showing 1–50 of 297 papers

TitleStatusHype
BlazePose: On-device Real-time Body Pose trackingCode4
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language TranslationCode2
Uni-Sign: Toward Unified Sign Language Understanding at ScaleCode2
Better Sign Language Translation with STMC-TransformerCode1
Stochastic Fine-grained Labeling of Multi-state Sign Glosses for Continuous Sign Language RecognitionCode1
Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognitionCode1
Sign Language Recognition via Skeleton-Aware Multi-Model EnsembleCode1
Improving Continuous Sign Language Recognition with Adapted Image ModelsCode1
Handling sign language transcription system with the computer-friendly numerical multilabelsCode1
Sign Language Recognition, Generation, and Translation: An Interdisciplinary PerspectiveCode1
SLGTformer: An Attention-Based Approach to Sign Language RecognitionCode1
SlowFast Network for Continuous Sign Language RecognitionCode1
Temporal Lift Pooling for Continuous Sign Language RecognitionCode1
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods ComparisonCode1
Dynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language RecognitionCode1
Continuous Sign Language Recognition with Correlation NetworkCode1
Fingerspelling recognition in the wild with iterative visual attentionCode1
Improving Continuous Sign Language Recognition with Consistency Constraints and Signer RemovalCode1
MASA: Motion-aware Masked Autoencoder with Semantic Alignment for Sign Language RecognitionCode1
OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across LanguagesCode1
Self-Mutual Distillation Learning for Continuous Sign Language RecognitionCode1
SignCLIP: Connecting Text and Sign Language by Contrastive LearningCode1
Sign Pose-Based Transformer for Word-Level Sign Language RecognitionCode1
Skeleton Aware Multi-modal Sign Language RecognitionCode1
Slovo: Russian Sign Language DatasetCode1
A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationCode1
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data AugmentationCode1
Isolated Sign Language Recognition based on Tree Structure Skeleton ImagesCode1
Sign Language Transformers: Joint End-to-end Sign Language Recognition and TranslationCode1
Visual Alignment Constraint for Continuous Sign Language RecognitionCode1
BSL-1K: Scaling up co-articulated sign language recognition using mouthing cuesCode1
Context Matters: Self-Attention for Sign Language RecognitionCode1
CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal CorrelationCode1
CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational AlignmentCode1
AdaBrowse: Adaptive Video Browser for Efficient Continuous Sign Language RecognitionCode1
Fine-tuning of sign language recognition models: a technical reportCode1
Gloss-free Sign Language Translation: Improving from Visual-Language PretrainingCode1
Hierarchical Windowed Graph Attention Network and a Large Scale Dataset for Isolated Indian Sign Language RecognitionCode1
Isolated Sign Recognition from RGB Video using Pose Flow and Self-AttentionCode1
LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture RecognitionCode1
Multi-Stream Keypoint Attention Network for Sign Language Recognition and TranslationCode1
On the Importance of Sign Labeling: The Hamburg Sign Language Notation System Case StudyCode1
Quantitative Survey of the State of the Art in Sign Language RecognitionCode1
Self-Emphasizing Network for Continuous Sign Language RecognitionCode1
Self-Supervised Representation Learning with Spatial-Temporal Consistency for Sign Language RecognitionCode1
Siformer: Feature-isolated Transformer for Efficient Skeleton-based Sign Language RecognitionCode1
C2SLR: Consistency-Enhanced Continuous Sign Language RecognitionCode1
All You Need In Sign Language Production—0
ASL-Skeleton3D and ASL-Phono: Two Novel Datasets for the American Sign Language—0
A Comprehensive Review of Sign Language Recognition: Different Types, Modalities, and Datasets—0
Show:102550
← PrevPage 1 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SubUNetsWord Error Rate (WER)40.7—Unverified
2CTF-MMWord Error Rate (WER)37.8—Unverified
3DTNWord Error Rate (WER)36.5—Unverified
4SANWord Error Rate (WER)29.7—Unverified
5Stochastic CSLRWord Error Rate (WER)25.3—Unverified
6CrossModalWord Error Rate (WER)24—Unverified
7SLRGANWord Error Rate (WER)23.4—Unverified
8DNFWord Error Rate (WER)22.86—Unverified
9VACWord Error Rate (WER)22.1—Unverified
10MSKA-SLRWord Error Rate (WER)22.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Stochastic CSLRWord Error Rate (WER)26.1—Unverified
2CrossModalWord Error Rate (WER)24.3—Unverified
3SignBTWord Error Rate (WER)23.9—Unverified
4MMTLBWord Error Rate (WER)22.45—Unverified
5SMKDWord Error Rate (WER)22.4—Unverified
6STMCWord Error Rate (WER)21—Unverified
7WRNN + LETWord Error Rate (WER)20.73—Unverified
8MSKA-SLRWord Error Rate (WER)20.5—Unverified
9C2SLRWord Error Rate (WER)20.4—Unverified
10SignBERT+Word Error Rate (WER)19.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BN-TIN+Transf.Word Error Rate (WER)33.1—Unverified
2C2SLRWord Error Rate (WER)31—Unverified
3SENWord Error Rate (WER)30.7—Unverified
4AdaBrowseWord Error Rate (WER)30.6—Unverified
5CorrNetWord Error Rate (WER)30.1—Unverified
6CTCAWord Error Rate (WER)29.4—Unverified
7TCNetWord Error Rate (WER)29.3—Unverified
8CorrNet+ACDRWord Error Rate (WER)29—Unverified
9MSKA-SLRWord Error Rate (WER)27.8—Unverified
10Swin-MSTPWord Error Rate (WER)27.1—Unverified
#ModelMetricClaimedVerifiedStatus
1STF+LSTMRank-1 Recognition Rate0.99—Unverified
2SAM-SLR (RGB-D)Rank-1 Recognition Rate0.99—Unverified
33D-DCNN + ST-MGCNRank-1 Recognition Rate0.98—Unverified
4Ensemble - NTISRank-1 Recognition Rate0.96—Unverified
5HWGATRank-1 Recognition Rate0.96—Unverified
6MViT-SLRRank-1 Recognition Rate0.96—Unverified
7FE+LSTMRank-1 Recognition Rate0.93—Unverified
8VTN-PFRank-1 Recognition Rate0.93—Unverified
9CNN+FPM+BLSTM+Attention (RGB-D)Rank-1 Recognition Rate0.62—Unverified
#ModelMetricClaimedVerifiedStatus
1Logos-PretrainingTop-1 Accuracy66.82—Unverified
2Uni-SignTop-1 Accuracy63.52—Unverified
3NLA-SLRTop-1 Accuracy61.26—Unverified
4StepNetTop-1 Accuracy61.17—Unverified
5SAM-SLRTop-1 Accuracy58.73—Unverified
6SWIN-SLRTop-1 Accuracy58.51—Unverified
7HWGATTop-1 Accuracy48.49—Unverified
8I3D (pretraining: BSL-1K)Top-1 Accuracy46.82—Unverified
9I3DTop-1 Accuracy32.48—Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SignTop-1 Accuracy92.25—Unverified
2SiformerTop-1 Accuracy86.5—Unverified
3SignBERTTop-1 Accuracy83.3—Unverified
4I3D, ST-GCNTop-1 Accuracy81.38—Unverified
5StepNetTop-1 Accuracy78.29—Unverified
6I3DTop-1 Accuracy65.89—Unverified
7SPOTERTop-1 Accuracy63.18—Unverified
#ModelMetricClaimedVerifiedStatus
1HandReader_RGBCER (%)30.7—Unverified
2HandReader_KPCER (%)28—Unverified
3HandReader_RGBCER (%)27.6—Unverified
4HandReader_RGB_KPCER (%)27.1—Unverified
5HandReader_KPCER (%)26.2—Unverified
6HandReader_RGB+KPCER (%)24.4—Unverified
#ModelMetricClaimedVerifiedStatus
1SPOTERAccuracy (%)100—Unverified
2SiformerAccuracy (%)99.84—Unverified
3HWGATAccuracy (%)98.59—Unverified
4Bag of words fusion of hand pose/movement/positionAccuracy (%)97—Unverified
53DGCNAccuracy (%)94.84—Unverified
#ModelMetricClaimedVerifiedStatus
1HandReader_RGBCER (%)7.61—Unverified
2HandReader_KPCER (%)7.35—Unverified
3HandReader_RGB_KPCER (%)5.06—Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SignP-I Top-1 Accuracy78.16—Unverified
2SignBERT+P-I Top-1 Accuracy73.71—Unverified
#ModelMetricClaimedVerifiedStatus
1StepNetTop-1 Accuracy61.17—Unverified
2SignBERT+Top-1 Accuracy55.59—Unverified
#ModelMetricClaimedVerifiedStatus
1StepNetActions Top-177.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MobileNetV2_TSMAccuracy (Top-1)83.6—Unverified
#ModelMetricClaimedVerifiedStatus
1HWGATTop-1 Accuracy93.86—Unverified
#ModelMetricClaimedVerifiedStatus
13D-DCNN + ST-MGCNRank-1 Recognition Rate0.98—Unverified
#ModelMetricClaimedVerifiedStatus
1Skeleton Image RepresentationAccuracy82—Unverified
#ModelMetricClaimedVerifiedStatus
1Skeleton Image RepresentationAccuracy93—Unverified
#ModelMetricClaimedVerifiedStatus
1mVITv2-SMean Accuracy64.09—Unverified