SOTAVerified

BlazePose: On-device Real-time Body Pose tracking

2020-06-17Code Available4· sign in to hype

Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, Matthias Grundmann

Code Available — Be the first to reproduce this paper.

Reproduce

Code

Abstract

We present BlazePose, a lightweight convolutional neural network architecture for human pose estimation that is tailored for real-time inference on mobile devices. During inference, the network produces 33 body keypoints for a single person and runs at over 30 frames per second on a Pixel 2 phone. This makes it particularly suited to real-time use cases like fitness tracking and sign language recognition. Our main contributions include a novel body pose tracking solution and a lightweight body pose estimation neural network that uses both heatmaps and regression to keypoint coordinates.

Tasks

Benchmark Results

DatasetModelMetricClaimedVerifiedStatus
Google-AROpenPose (body only)PCK@0.287.8Unverified
Google-ARBlazePose FullPCK@0.284.1Unverified
Google-ARBlazePose LitePCK@0.279.6Unverified
Google-YogaBlazePose FullPCK@0.284.5Unverified
Google-YogaOpenPose (body only)PCK@0.283.4Unverified
Google-YogaBlazePose LitePCK@0.277.6Unverified

Reproductions