A Primer on Motion Capture with Deep Learning: Principles, Pitfalls and Perspectives
2020-09-01Code Available1· sign in to hype
Alexander Mathis, Steffen Schneider, Jessy Lauer, Mackenzie W. Mathis
Code Available — Be the first to reproduce this paper.
ReproduceCode
- github.com/DeepLabCut/Primer-MotionCaptureOfficialIn papernone★ 22
Abstract
Extracting behavioral measurements non-invasively from video is stymied by the fact that it is a hard computational problem. Recent advances in deep learning have tremendously advanced predicting posture from videos directly, which quickly impacted neuroscience and biology more broadly. In this primer we review the budding field of motion capture with deep learning. In particular, we will discuss the principles of those novel algorithms, highlight their potential as well as pitfalls for experimentalists, and provide a glimpse into the future.