SOTAVerified

Sign Language Recognition

Sign Language Recognition is a computer vision and natural language processing task that involves automatically recognizing and translating sign language gestures into written or spoken language. The goal of sign language recognition is to develop algorithms that can understand and interpret sign language, enabling people who use sign language as their primary mode of communication to communicate more easily with non-signers.

( Image credit: Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison )

Papers

Showing 1–50 of 297 papers

TitleStatusHype
BlazePose: On-device Real-time Body Pose trackingCode4
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language TranslationCode2
Uni-Sign: Toward Unified Sign Language Understanding at ScaleCode2
Handling sign language transcription system with the computer-friendly numerical multilabelsCode1
Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognitionCode1
OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across LanguagesCode1
SLGTformer: An Attention-Based Approach to Sign Language RecognitionCode1
Siformer: Feature-isolated Transformer for Efficient Skeleton-based Sign Language RecognitionCode1
Sign Language Recognition via Skeleton-Aware Multi-Model EnsembleCode1
Skeleton Aware Multi-modal Sign Language RecognitionCode1
SlowFast Network for Continuous Sign Language RecognitionCode1
Temporal Lift Pooling for Continuous Sign Language RecognitionCode1
Multi-Stream Keypoint Attention Network for Sign Language Recognition and TranslationCode1
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods ComparisonCode1
Self-Emphasizing Network for Continuous Sign Language RecognitionCode1
BSL-1K: Scaling up co-articulated sign language recognition using mouthing cuesCode1
CVT-SLR: Contrastive Visual-Textual Transformation for Sign Language Recognition with Variational AlignmentCode1
Self-Supervised Representation Learning with Spatial-Temporal Consistency for Sign Language RecognitionCode1
Isolated Sign Language Recognition based on Tree Structure Skeleton ImagesCode1
Sign Language Recognition, Generation, and Translation: An Interdisciplinary PerspectiveCode1
Sign Pose-Based Transformer for Word-Level Sign Language RecognitionCode1
Improving Continuous Sign Language Recognition with Adapted Image ModelsCode1
LD-ConGR: A Large RGB-D Video Dataset for Long-Distance Continuous Gesture RecognitionCode1
Stochastic Fine-grained Labeling of Multi-state Sign Glosses for Continuous Sign Language RecognitionCode1
Isolated Sign Recognition from RGB Video using Pose Flow and Self-AttentionCode1
A Simple Multi-Modality Transfer Learning Baseline for Sign Language TranslationCode1
Self-Mutual Distillation Learning for Continuous Sign Language RecognitionCode1
MASA: Motion-aware Masked Autoencoder with Semantic Alignment for Sign Language RecognitionCode1
On the Importance of Sign Labeling: The Hamburg Sign Language Notation System Case StudyCode1
Visual Alignment Constraint for Continuous Sign Language RecognitionCode1
SignCLIP: Connecting Text and Sign Language by Contrastive LearningCode1
Dynamic Spatial-Temporal Aggregation for Skeleton-Aware Sign Language RecognitionCode1
C2SLR: Consistency-Enhanced Continuous Sign Language RecognitionCode1
Quantitative Survey of the State of the Art in Sign Language RecognitionCode1
AdaBrowse: Adaptive Video Browser for Efficient Continuous Sign Language RecognitionCode1
Context Matters: Self-Attention for Sign Language RecognitionCode1
CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal CorrelationCode1
Continuous Sign Language Recognition with Correlation NetworkCode1
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data AugmentationCode1
Gloss-free Sign Language Translation: Improving from Visual-Language PretrainingCode1
Fingerspelling recognition in the wild with iterative visual attentionCode1
Fine-tuning of sign language recognition models: a technical reportCode1
Sign Language Transformers: Joint End-to-end Sign Language Recognition and TranslationCode1
Better Sign Language Translation with STMC-TransformerCode1
Hierarchical Windowed Graph Attention Network and a Large Scale Dataset for Isolated Indian Sign Language RecognitionCode1
Improving Continuous Sign Language Recognition with Consistency Constraints and Signer RemovalCode1
Slovo: Russian Sign Language DatasetCode1
ASL Trigger Recognition in Mixed Activity/Signing Sequences for RF Sensor-Based User InterfacesCode0
Neural Sign Language TranslationCode0
LSFB-CONT and LSFB-ISOL: Two New Datasets for Vision-Based Sign Language RecognitionCode0
Show:102550
← PrevPage 1 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1SubUNetsWord Error Rate (WER)40.7—Unverified
2CTF-MMWord Error Rate (WER)37.8—Unverified
3DTNWord Error Rate (WER)36.5—Unverified
4SANWord Error Rate (WER)29.7—Unverified
5Stochastic CSLRWord Error Rate (WER)25.3—Unverified
6CrossModalWord Error Rate (WER)24—Unverified
7SLRGANWord Error Rate (WER)23.4—Unverified
8DNFWord Error Rate (WER)22.86—Unverified
9VACWord Error Rate (WER)22.1—Unverified
10MSKA-SLRWord Error Rate (WER)22.1—Unverified
#ModelMetricClaimedVerifiedStatus
1Stochastic CSLRWord Error Rate (WER)26.1—Unverified
2CrossModalWord Error Rate (WER)24.3—Unverified
3SignBTWord Error Rate (WER)23.9—Unverified
4MMTLBWord Error Rate (WER)22.45—Unverified
5SMKDWord Error Rate (WER)22.4—Unverified
6STMCWord Error Rate (WER)21—Unverified
7WRNN + LETWord Error Rate (WER)20.73—Unverified
8MSKA-SLRWord Error Rate (WER)20.5—Unverified
9C2SLRWord Error Rate (WER)20.4—Unverified
10SignBERT+Word Error Rate (WER)19.9—Unverified
#ModelMetricClaimedVerifiedStatus
1BN-TIN+Transf.Word Error Rate (WER)33.1—Unverified
2C2SLRWord Error Rate (WER)31—Unverified
3SENWord Error Rate (WER)30.7—Unverified
4AdaBrowseWord Error Rate (WER)30.6—Unverified
5CorrNetWord Error Rate (WER)30.1—Unverified
6CTCAWord Error Rate (WER)29.4—Unverified
7TCNetWord Error Rate (WER)29.3—Unverified
8CorrNet+ACDRWord Error Rate (WER)29—Unverified
9MSKA-SLRWord Error Rate (WER)27.8—Unverified
10Swin-MSTPWord Error Rate (WER)27.1—Unverified
#ModelMetricClaimedVerifiedStatus
1STF+LSTMRank-1 Recognition Rate0.99—Unverified
2SAM-SLR (RGB-D)Rank-1 Recognition Rate0.99—Unverified
33D-DCNN + ST-MGCNRank-1 Recognition Rate0.98—Unverified
4Ensemble - NTISRank-1 Recognition Rate0.96—Unverified
5HWGATRank-1 Recognition Rate0.96—Unverified
6MViT-SLRRank-1 Recognition Rate0.96—Unverified
7FE+LSTMRank-1 Recognition Rate0.93—Unverified
8VTN-PFRank-1 Recognition Rate0.93—Unverified
9CNN+FPM+BLSTM+Attention (RGB-D)Rank-1 Recognition Rate0.62—Unverified
#ModelMetricClaimedVerifiedStatus
1Logos-PretrainingTop-1 Accuracy66.82—Unverified
2Uni-SignTop-1 Accuracy63.52—Unverified
3NLA-SLRTop-1 Accuracy61.26—Unverified
4StepNetTop-1 Accuracy61.17—Unverified
5SAM-SLRTop-1 Accuracy58.73—Unverified
6SWIN-SLRTop-1 Accuracy58.51—Unverified
7HWGATTop-1 Accuracy48.49—Unverified
8I3D (pretraining: BSL-1K)Top-1 Accuracy46.82—Unverified
9I3DTop-1 Accuracy32.48—Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SignTop-1 Accuracy92.25—Unverified
2SiformerTop-1 Accuracy86.5—Unverified
3SignBERTTop-1 Accuracy83.3—Unverified
4I3D, ST-GCNTop-1 Accuracy81.38—Unverified
5StepNetTop-1 Accuracy78.29—Unverified
6I3DTop-1 Accuracy65.89—Unverified
7SPOTERTop-1 Accuracy63.18—Unverified
#ModelMetricClaimedVerifiedStatus
1HandReader_RGBCER (%)30.7—Unverified
2HandReader_KPCER (%)28—Unverified
3HandReader_RGBCER (%)27.6—Unverified
4HandReader_RGB_KPCER (%)27.1—Unverified
5HandReader_KPCER (%)26.2—Unverified
6HandReader_RGB+KPCER (%)24.4—Unverified
#ModelMetricClaimedVerifiedStatus
1SPOTERAccuracy (%)100—Unverified
2SiformerAccuracy (%)99.84—Unverified
3HWGATAccuracy (%)98.59—Unverified
4Bag of words fusion of hand pose/movement/positionAccuracy (%)97—Unverified
53DGCNAccuracy (%)94.84—Unverified
#ModelMetricClaimedVerifiedStatus
1HandReader_RGBCER (%)7.61—Unverified
2HandReader_KPCER (%)7.35—Unverified
3HandReader_RGB_KPCER (%)5.06—Unverified
#ModelMetricClaimedVerifiedStatus
1Uni-SignP-I Top-1 Accuracy78.16—Unverified
2SignBERT+P-I Top-1 Accuracy73.71—Unverified
#ModelMetricClaimedVerifiedStatus
1StepNetTop-1 Accuracy61.17—Unverified
2SignBERT+Top-1 Accuracy55.59—Unverified
#ModelMetricClaimedVerifiedStatus
1StepNetActions Top-177.1—Unverified
#ModelMetricClaimedVerifiedStatus
1MobileNetV2_TSMAccuracy (Top-1)83.6—Unverified
#ModelMetricClaimedVerifiedStatus
1HWGATTop-1 Accuracy93.86—Unverified
#ModelMetricClaimedVerifiedStatus
13D-DCNN + ST-MGCNRank-1 Recognition Rate0.98—Unverified
#ModelMetricClaimedVerifiedStatus
1Skeleton Image RepresentationAccuracy82—Unverified
#ModelMetricClaimedVerifiedStatus
1Skeleton Image RepresentationAccuracy93—Unverified
#ModelMetricClaimedVerifiedStatus
1mVITv2-SMean Accuracy64.09—Unverified