BlazePose: On-device Real-time Body Pose tracking
2020-06-17Code Available4· sign in to hype
Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, Matthias Grundmann
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/google/mediapipeOfficialtf★ 34,276
- github.com/geaxgx/depthai_blazeposepytorch★ 393
- github.com/VNOpenAI/tf-blazeposetf★ 211
- github.com/vietanhdev/tf-blazeposetf★ 211
- github.com/jiang-du/BlazePose-tensorflowtf★ 112
- github.com/vladmandic/blazeposetf★ 19
- github.com/axinc-ai/ailia-models/tree/master/pose_estimation_3d/blazepose-fullbodynone★ 0
Abstract
We present BlazePose, a lightweight convolutional neural network architecture for human pose estimation that is tailored for real-time inference on mobile devices. During inference, the network produces 33 body keypoints for a single person and runs at over 30 frames per second on a Pixel 2 phone. This makes it particularly suited to real-time use cases like fitness tracking and sign language recognition. Our main contributions include a novel body pose tracking solution and a lightweight body pose estimation neural network that uses both heatmaps and regression to keypoint coordinates.
Tasks
Benchmark Results
| Dataset | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| Google-AR | OpenPose (body only) | PCK@0.2 | 87.8 | — | Unverified |
| Google-AR | BlazePose Full | PCK@0.2 | 84.1 | — | Unverified |
| Google-AR | BlazePose Lite | PCK@0.2 | 79.6 | — | Unverified |
| Google-Yoga | BlazePose Full | PCK@0.2 | 84.5 | — | Unverified |
| Google-Yoga | OpenPose (body only) | PCK@0.2 | 83.4 | — | Unverified |
| Google-Yoga | BlazePose Lite | PCK@0.2 | 77.6 | — | Unverified |