SOTAVerified

BlazePose: On-device Real-time Body Pose tracking

2020-06-17Code Available4· sign in to hype

Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, Matthias Grundmann

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We present BlazePose, a lightweight convolutional neural network architecture for human pose estimation that is tailored for real-time inference on mobile devices. During inference, the network produces 33 body keypoints for a single person and runs at over 30 frames per second on a Pixel 2 phone. This makes it particularly suited to real-time use cases like fitness tracking and sign language recognition. Our main contributions include a novel body pose tracking solution and a lightweight body pose estimation neural network that uses both heatmaps and regression to keypoint coordinates.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Google-AROpenPose (body only)[email protected]87.8Unverified
Google-ARBlazePose Full[email protected]84.1Unverified
Google-ARBlazePose Lite[email protected]79.6Unverified
Google-YogaBlazePose Full[email protected]84.5Unverified
Google-YogaOpenPose (body only)[email protected]83.4Unverified
Google-YogaBlazePose Lite[email protected]77.6Unverified

Reproductions