A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

Yu Y, Mora KAF, Odobez JM. Robust and accurate 3D head pose estimation through 3DMM and online head model reconstruction[C]. 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition. fg IEEE. 2017;2017:711–8.

Google Scholar 

Xia L, Chen CC, Aggarwal J K. Human detection using depth information by kinect[C]. CVPR 2011 workshops. IEEE; 2011. p. 15-22.

Murphy-Chutorian E, Trivedi MM. Head pose estimation in computer vision: A survey[J]. IEEE Trans Pattern Anal Mach Intell. 2008;31(4):607–26.

Article  Google Scholar 

Tran C, Trivedi MM. Vision for driver assistance: Looking at people in a vehicle, in Visual Analysis of Humans. Springer; 2011. p. 597–614. 1.

Wang Q, Lei H, Ma X, et al. CNN Network for Head Detection with Depth Images in cyber-physical systems[C]. 2020 International Conferences on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics). IEEE; 2020. p. 544–549.

Borghi G, Fabbri M, Vezzani R, et al. Face-from-depth for head pose estimation on depth images[J]. IEEE Trans Pattern Anal Mach Intell. 2018;42(3):596–609.

Article  Google Scholar 

Ballotta D, Borghi G, Vezzani R, et al. Head detection with depth images in the wild[J]. arXiv preprint arXiv:1707.06786, 2017.

Ballotta D, Borghi G, Vezzani R, et al. Fully convolutional network for head detection with depth images[C]. 2018 24th International Conference on Pattern Recognition (ICPR). IEEE; 2018. p. 752–757.

Khan M H, Shirahama K, Farid M S, et al. Multiple human detection in depth images[C]. 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP). IEEE; 2016. p. 1–6.

Hsu HW, Wu TY, Wan S, et al. Quatnet: Quaternion-based head pose estimation with multiregression loss[J]. IEEE Trans Multimedia. 2018;21(4):1035–46.

Article  Google Scholar 

Dalal N, Triggs B. Histograms of oriented gradients for human detection[C]. 2005 IEEE Comput Soc Conf Comput Vis Pattern Recognit (CVPR'05). Ieee. 2005;1:886-893.

Thurau C. Behavior histograms for action recognition and human detection[C]//Workshop on Human Motion. Berlin, Heidelberg: Springer; 2007. p. 299–312.

Google Scholar 

Yan J, Zhang X, Lei Z, et al. Real-time high performance deformable model for face detection in the wild[C]. 2013 Int Conf Biometrics (ICB). IEEE; 2013. p. 1–6.

Schmidhuber J. Deep learning in neural networks: An overview[J]. Neural Netw. 2015;61:85–117.

Article  Google Scholar 

Girshick R, Donahue J, Darrell T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]. Proc IEEE Conf Comput Vis Pattern Recognit. 2014. p. 580–587.

Vu T H, Osokin A, Laptev I. Context-aware CNNs for person head detection[C]. Proc IEEE Int Conf Comput Vis. 2015. p. 2893–2901.

Ren S, He K, Girshick R, et al. Faster r-cnn: Towards real-time object detection with region proposal networks[J]. Adv Neural Inf Process Syst. 2015. p. 28.

Chen S, Bremond F, Nguyen H, et al. Exploring depth information for head detection with depth images[C]. 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE; 2016. p. 228–234.

Fanelli G, Gall J, Van Gool L. Real time head pose estimation with random regression forests[C]//CVPR. IEEE. 2011;2011:617–24.

Google Scholar 

Ahn B, Park J, Kweon I S. Real-time head orientation from a monocular camera using deep neural network[C]. Asian conference on computer vision. Springer, Cham; 2014. p. 82–96.

Drouard V, Ba S, Evangelidis G, et al. Head pose estimation via probabilistic high-dimensional regression[C]. 2015 IEEE international conference on image processing (ICIP). IEEE; 2015. p. 4624–4628.

Zhu X, Lei Z, Liu X, et al. Face alignment across large poses: A 3d solution[C]. Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 146–155.

Patacchiola M, Cangelosi A. Head pose estimation in the wild using convolutional neural networks and adaptive gradient methods[J]. Pattern Recogn. 2017;71:132–43.

Article  Google Scholar 

Drouard V, Ba S, Horaud R. Switching linear inverse-regression model for tracking head pose[C]. 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE; 2017. p. 1232–1240.

Lathuilière S, Juge R, Mesejo P, et al. Deep mixture of linear inverse regressions applied to head-pose estimation[C]. Proc IEEE Conf Comput Vis Pattern Recognit. 2017. p. 4817–4825.

Xu X, Kakadiaris IA. Joint head pose estimation and face alignment framework using global and local CNN features[C]. 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017). IEEE; 2017. p. 642–649.

Liu X, Liang W, Wang Y, et al. 3D head pose estimation with convolutional neural network trained on synthetic images[C]. 2016 IEEE international conference on image processing (ICIP). IEEE; 2016. p. 1289–1293.

Khan K, Mauro M, Migliorati P, et al. Head pose estimation through multi-class face segmentation[C]. 2017 IEEE International Conference on Multimedia and Expo (ICME). IEEE; 2017. p. 175–180.

Ruiz N, Chong E, Rehg J M. Fine-grained head pose estimation without keypoints[C]. Proc IEEE Conf Comput Vis Pattern Recognit Workshops. 2018. p. 2074–2083.

Yang J, Liang W, Jia Y. Face pose estimation with combined 2d and 3d hog features[C]. Proc 21st Int Conf Pattern Recognit (ICPR2012). IEEE; 2012. p. 2492–2495.

Mukherjee SS, Robertson NM. Deep head pose: Gaze-direction estimation in multimodal video[J]. IEEE Trans Multimedia. 2015;17(11):2094–107.

Article  Google Scholar 

Li S, Ngan KN, Paramesran R, et al. Real-time head pose tracking with online face template reconstruction[J]. IEEE Trans Pattern Anal Mach Intell. 2015;38(9):1922–8.

Article  Google Scholar 

Malassiotis S, Strintzis MG. Robust real-time 3D head pose estimation from range data[J]. Pattern Recogn. 2005;38(8):1153–65.

Article  Google Scholar 

Breitenstein M D, Kuettel D, Weise T, et al. Real-time face pose estimation from single range images[C]. 2008 IEEE Conf Comput Vis Pattern Recognit. IEEE; 2008. p. 1–8.

Padeleris P, Zabulis X, Argyros A A. Head pose estimation on depth data based on particle swarm optimization[C]. 2012 IEEE Comput Soc Conf Comput Vis Pattern Recognit Workshops. IEEE; 2012. p. 42–49.

Papazov C, Marks T K, Jones M. Real-time 3D head pose and facial landmark estimation from depth images using triangular surface patch features[C]. Proc IEEE Conf Comput Vis Pattern Recognit. 2015. p. 4722–4730.

Sheng L, Cai J, Cham TJ, et al. A generative model for depth-based robust 3D facial pose tracking[C]. Proc IEEE Conf Comput Vis Pattern Recognit. 2017. p. 4488–4497.

Venturelli M, Borghi G, Vezzani R, et al. From depth data to head pose estimation: a siamese approach[J]. arXiv preprint arXiv:1703.03624. 2017.

Shihua X, Nan S, Xupeng W. 3D point cloud head pose estimation based on deep learning[J]. Journal of Computer Applications. 2020;40(4):996.

Google Scholar 

Ma X, Sang N, Xiao S, et al. Learning a Deep Regression Forest for Head Pose Estimation from a Single Depth Image[J]. J Circuits Syst Comput. 2021;30(08):2150139.

Article  Google Scholar 

Comaniciu D, Meer P. Mean shift: A robust approach toward feature space analysis[J]. IEEE Trans Pattern Anal Mach Intell. 2002;24(5):603–19.

Article  Google Scholar 

Ranjan R, Castillo CD, Chellappa R. L2-constrained softmax loss for discriminative face verification[J]. arXiv preprint arXiv:1703.09507, 2017.

Xiao S, Sang N, Wang X, et al. Leveraging ordinal regression with soft labels for 3d head pose estimation from point sets[C]. ICASSP 2020–2020 IEEE Int Conf Acoust Speech Signal Process (ICASSP). IEEE; 2020. p. 1883–1887.

Diaz R, Marathe A. Soft labels for ordinal regression[C]. Proc IEEE/CVF Conf Comput Vis Pattern Recognit. 2019. p. 4738–4747.

Wu C, Zhang J, Savarese S, et al. Watch-n-patch: Unsupervised understanding of actions and relations[C]. Proc IEEE Conf Comput Vis Pattern Recognit. 2015. p. 4362–4370.

Baltrušaitis T, Robinson P, Morency LP. 3D constrained local model for rigid and non-rigid facial tracking[C]. 2012 IEEE Conf Comput Vis Pattern Recognit. IEEE; 2012. 2610–2617

Fathian K, Ramirez-Paredes JP, Doucette EA, et al. Quest: A quaternion-based approach for camera motion estimation from minimal feature points[J]. IEEE Robot Autom Lett. 2018;3(2):857–64.

Article  Google Scholar 

Wang Q, Lei H, Qian W. Siamese PointNet: 3D Head Pose Estimation with Local Feature Descriptor[J]. Electronics. 2023;12(5):1194.

Article  Google Scholar 

Comments (0)

No login
gif