Foreground and scene structure preserved visual privacy protection using depth information

Semir Elezovikj, Haibin Ling, Xiufang Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

In this paper, we propose the use of depth-information to protect privacy in person-aware visual systems while preserving important foreground subjects and scene structures. We aim to preserve the identity of foreground subjects while hiding superfluous details in the background that may contain sensitive information. We achieve this goal by using depth information and relevant human detection mechanisms provided by the Kinect sensor. In particular, for an input color and depth image pair, we first create a sensitivity map which favors background regions (where privacy should be preserved) and low depth-gradient pixels (which often relates a lot to scene structure but little to identity). We then combine this per-pixel sensitivity map with an inhomogeneous image obscuration process for privacy protection. We tested the proposed method using data involving different scenarios including various illumination conditions, various number of subjects, different context, etc. The experiments demonstrate the quality of preserving the identity of humans and edges obtained from the depth information while obscuring privacy-intrusive information in the background.

Original languageEnglish (US)
Title of host publicationElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
DOIs
Publication statusPublished - Nov 29 2013
Event2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 - San Jose, CA, United States
Duration: Jul 15 2013Jul 19 2013

Publication series

NameElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

Other

Other2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
CountryUnited States
CitySan Jose, CA
Period7/15/137/19/13

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Elezovikj, S., Ling, H., & Chen, X. (2013). Foreground and scene structure preserved visual privacy protection using depth information. In Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 [6618246] (Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013). https://doi.org/10.1109/ICMEW.2013.6618246