OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields

来自NERCN

推荐理由

二维人体姿态估计方法领域的经典文章,提出了多人实时二维姿态估计方法,在计算资源可观的情况下兼具实时性和较高的准确度,在该领域内的相关研究应用中被广泛引用。

文章简介
期刊 CVPR 2017
发表年份 2017
DOI 10.48550/arXiv.1812.08008
类型 研究性工作
领域 计算机视觉
引用量 11783
推荐信息
推荐人 阿璐思
审核 王伟明 张琛
推荐小组 动捕小组

摘要

Realtime multi-person 2D pose estimation is a key component in enabling machines to have an understanding of people in images and videos. In this work, we present a realtime approach to detect the 2D pose of multiple people in an image. The proposed method uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body parts with individuals in the image. This bottom-up system achieves high accuracy and realtime performance, regardless of the number of people in the image. In previous work, PAFs and body part location estimation were refined simultaneously across training stages. We demonstrate that a PAF-only refinement rather than both PAF and body part location refinement results in a substantial increase in both runtime performance and accuracy. We also present the first combined body and foot keypoint detector, based on an internal annotated foot dataset that we have publicly released. We show that the combined detector not only reduces the inference time compared to running them sequentially, but also maintains the accuracy of each component individually. This work has culminated in the release of OpenPose, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints.

细分领域

< | 人体姿态估计 | 二维