Learning a deep predictive coding network for a semi-supervised 3D-hand pose estimation

Simple item page
dc.contributor.authorBulugu, Isack
dc.contributor.authorBanzi, Jamal
dc.contributor.authorHuang, Shiliang
dc.contributor.authorYe, Zhongfu
dc.date.accessioned2020-04-07T05:18:22Z
dc.date.available2020-04-07T05:18:22Z
dc.date.issued2020-03-27
dc.description.abstractIn this paper we present a CNN based approach for a real time 3D-hand pose estimation from the depth sequence. Prior discriminative approaches have achieved remarkable success but are facing two main challenges: Firstly, the methods are fully supervised hence require large numbers of annotated training data to extract the dynamic information from a hand representation. Secondly, unreliable hand detectors based on strong assumptions or a weak detector which often fail in several situations like complex environment and multiple hands. In contrast to these methods, this paper presents an approach that can be considered as semi-supervised by performing predictive coding of image sequences of hand poses in order to capture latent features underlying a given image without supervision. The hand is modelled using a novel latent tree dependency model ( LDTM ) which transforms internal joint location to an explicit representation. Then the modeled hand topology is integrated with the pose estimator using data dependent method to jointly learn latent variables of the posterior pose appearance and the pose configuration respectively. Finally, an unsupervised error term which is a part of the recurrent architecture ensures smooth estimations of the final pose. Experiments on three challenging public datasets, ICVL, MSRA, and NYU demonstrate the significant performance of the proposed method which is comparable or better than state-of-the-art approaches.en_US
dc.identifier.citationIEEEen_US
dc.identifier.doi10.1109/JAS.2020.1003090
dc.identifier.issn2329-9274
dc.identifier.urihttp://hdl.handle.net/20.500.11810/5411
dc.publisherIEEEen_US
dc.subjectHand pose estimation; Convolutional neural networks; Recurrent neural networks; Human-machine interaction; semi supervised learningen_US
dc.titleLearning a deep predictive coding network for a semi-supervised 3D-hand pose estimationen_US
dc.typeJournal Article, Peer Revieweden_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
In this paper we present a CNN based approach for a real time 3D.pdf
Size:
205.78 KB
Format:
Adobe Portable Document Format
Description:
Abstract
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Department of Electronics and Telecommunications Engineering