Skip to main navigation Skip to search Skip to main content

Human pose estimation using deep consensus voting

  • Weizmann Institute of Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

123 Scopus citations

Abstract

In this paper we consider the problem of human pose estimation from a single still image. We propose a novel approach where each location in the image votes for the position of each keypoint using a convolutional neural net. The voting scheme allows us to utilize information from the whole image, rather than rely on a sparse set of keypoint locations. Using dense, multi-target votes, not only produces good keypoint predictions, but also enables us to compute image-dependent joint keypoint probabilities by looking at consensus voting. This differs from most previous methods where joint probabilities are learned from relative keypoint locations and are independent of the image. We finally combine the keypoints votes and joint probabilities in order to identify the optimal pose configuration. We show our competitive performance on the MPII Human Pose and Leeds Sports Pose datasets.

Original languageEnglish
Title of host publicationComputer Vision - 14th European Conference, ECCV 2016, Proceedings
EditorsBastian Leibe, Nicu Sebe, Max Welling, Jiri Matas
PublisherSpringer Verlag
Pages246-260
Number of pages15
ISBN (Print)9783319464749
DOIs
StatePublished - 2016
Externally publishedYes
Event14th European Conference on Computer Vision, ECCV 2016 - Amsterdam, Netherlands
Duration: 8 Oct 2016 → 16 Oct 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9906 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th European Conference on Computer Vision, ECCV 2016
Country/TerritoryNetherlands
CityAmsterdam
Period8/10/16 → 16/10/16

Bibliographical note

Publisher Copyright:
© Springer International Publishing AG 2016.

Funding

This work was supported by ERC Advanced Grant 269627 Digital Baby and in part by the Center for Brains, Minds and Machines, funded by National Science Foundation Science and Technology Centers Award CCF-1231216. We thank the NVIDIA Corporation for providing GPUs through their academic program.

FundersFunder number
Center for Brains, Minds and Machines
National Science Foundation Science and Technology CentersCCF-1231216
European Commission269627

    Fingerprint

    Dive into the research topics of 'Human pose estimation using deep consensus voting'. Together they form a unique fingerprint.

    Cite this