{"id":6419,"date":"2020-09-01T13:45:21","date_gmt":"2020-09-01T13:45:21","guid":{"rendered":"http:\/\/new.bernhardrinner.com\/?page_id=6419"},"modified":"2020-11-09T06:36:47","modified_gmt":"2020-11-09T06:36:47","slug":"privacy-protection","status":"publish","type":"page","link":"https:\/\/bernhardrinner.com\/?page_id=6419","title":{"rendered":"Privacy protection"},"content":{"rendered":"\n<p>Sensors and in particular cameras have found their way into many parts of our daily lives. While monitoring public places is still a common use case for camera systems, applications in private environments are emerging. The ever growing number of cameras raises important questions concerning security and privacy. \u201cOur approach to tackle these questions is to protect all sensitive data before it leaves the camera,\u201d explains Bernhard Rinner. \u201cWe exploit the available computing resources of modern camera systems for onboard privacy protection and data security and do not rely on pure software solutions. We have successfully demonstrated this approach on several prototypes.\u201d<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:35% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"435\" height=\"358\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-M.jpg\" alt=\"\" class=\"wp-image-6347\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-M.jpg 435w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-M-300x247.jpg 300w\" sizes=\"auto, (max-width: 435px) 100vw, 435px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>The key idea is to \u201cprotect\u201d access to the image sensor and encapsulate dedicated security and privacy functionality in a <em>TrustEYE<\/em>\u2014a secure sensing unit embedded on the smart camera. The TrustEYE has exclusive access to the image sensor\u2019s raw data. It separates sensitive from non-sensitive data by applying dedicated image analysis and ensures that only non-sensitive data is made available to the camera host system.<\/p>\n<\/div><\/div>\n\n\n\n<p class=\"has-text-align-center\"><em>TrustEYE.M4 platform for secure and privacy-aware visual sensor networks<\/em>.<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:35% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"933\" height=\"583\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam.jpg\" alt=\"\" class=\"wp-image-6352\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam.jpg 933w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam-300x187.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam-768x480.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam-800x500.jpg 800w\" sizes=\"auto, (max-width: 933px) 100vw, 933px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>\u201cIn another prototype, we use modern hybrid ARM\/FPGA system-on-chip solutions to provide security and high speed image analysis functions,\u201d Ihtesham Haider points out. \u201cWe exploit inherent hardware properties in the form of <em>physical unclonable functions<\/em> to realize high levels of security without requiring additional specialized hardware for cryptographic functions.\u201d<\/p>\n<\/div><\/div>\n\n\n\n<p class=\"has-text-align-center\"><em>System-on-chip prototype with onboard security functionality.  Key generation based on physical unclonable functions, sensed data attestation, and secure boot of the sensor controller are implemented on a Xilinx Zynq7010.<\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed-vimeo wp-block-embed is-type-video is-provider-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"TrustEYE.M4 - An Embedded Visual Sensor Network (VSN) Platform Prototype\" src=\"https:\/\/player.vimeo.com\/video\/76936170?dnt=1&amp;app_id=122963\" width=\"800\" height=\"450\" frameborder=\"0\" allow=\"autoplay; fullscreen\" allowfullscreen><\/iframe>\n<\/div><figcaption>TrustEYE.M4 prototype presentation<\/figcaption><\/figure>\n\n\n\n<p>Privacy protection is achieved by intentionally distorting sensitive regions of the captured images. In a first approach we have developed so-called <em>cartooning privacy filters<\/em> which preserve privacy while ensuring a minimum reduction of the image fidelity and run onboard of our TrustEYE platform. <\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile is-vertically-aligned-center\" style=\"grid-template-columns:34% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"820\" height=\"406\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/09\/AHGMM-filter.jpg\" alt=\"\" class=\"wp-image-6493\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/09\/AHGMM-filter.jpg 820w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/09\/AHGMM-filter-300x149.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/09\/AHGMM-filter-768x380.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/09\/AHGMM-filter-800x396.jpg 800w\" sizes=\"auto, (max-width: 820px) 100vw, 820px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>Another approach was devoted towards privacy protection in recreational videography from small drones that can capture bystanders who may be uncomfortable about appearing in those videos. We have developed a robust spatio-temporal <em>hopping blur filter<\/em> that protects privacy through de-identification of face regions. Our filter distorts a face region with secret parameters to be robust to na\u00efve, parrot and reconstruction attacks. The distortion is minimal and adaptive to the resolution of the captured face: we select the smallest Gaussian kernel that reduces the face resolution below a certain threshold. This privacy filter is for on-board installation and produces temporally smooth and pleasant videos.<\/p>\n<\/div><\/div>\n\n\n\n<p class=\"has-text-align-center\"><em>Visualisation of hopping blur filtering. The face region is divided into sub-regions and each sub-region is convolved with a hopping Gaussian mixture model kernel based on random parameters<\/em>.<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Temporally Smooth Privacy Protected  Airborne Videos\" width=\"800\" height=\"600\" src=\"https:\/\/www.youtube.com\/embed\/YJrWRLrm0L0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><figcaption>Pseudo-random distortion of face regions in airborne videos to prevent a human or a face recogniser from inferring the identity of people. Motion-dependent spatio-temporal smoothing produces pleasant videos.<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<h4 class=\"wp-block-heading\">Funded projects<\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li><a href=\"https:\/\/trusteye.nes.aau.at\/prosecco\/index.html\">Progressing towards Secure, cooperating smart Cameras (ProSecCo)<\/a><br>Principal investigator. Funding from FFG, 2014-2017<\/li><li><a href=\"http:\/\/trusteye.aau.at\/\">Trustworthy Sensing and Collaboration in VSN (TrustEYE)<\/a><br>Principal investigator. Funding from KWF, 2012-2015<\/li><\/ul>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-group has-background\" style=\"background-color:#f0f0f0\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<h4 class=\"wp-block-heading\">Selected publications<\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Omair Sarwar, Bernhard Rinner and Andrea Cavallaro. <a href=\"https:\/\/doi.org\/10.1109\/ACCESS.2019.2944861\">A privacy-preserving filter for oblique face images based on adaptive hopping Gaussian mixtures<\/a>. <em>IEEE Access<\/em>, 7:142623-142639, 2019.<\/li><li>Bernhard Rinner. <a href=\"https:\/\/doi.org\/10.1109\/MC.2019.2905171\">Can we trust smart cameras.<\/a> <em>Computer<\/em>, 52(5):67-70, 2019.<\/li><li>Omair Sarwar, Andrea Cavallaro and Bernhard Rinner. <a href=\"https:\/\/bernhardrinner.com\/pubs\/2018\/Sawar_IROS2018.pdf\">Temporally smooth privacy protected airborne videos<\/a>. In <em>Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2018)<\/em>, Madrid, Spain. October 2018.<\/li><li>Ihtesham Haider, Michael Hoeberl and Bernhard Rinner. <a href=\"https:\/\/bernhardrinner.com\/pubs\/2016\/Haider_IOTPTS2016.pdf\">Trusted Sensors for Participatory Sensing and IoT Applications based on Physically Unclonable Functions<\/a>. In <em>Proceedings of the 2nd International Workshop on IoT Privacy, Trust, and Security (IoTPTS)<\/em>, Xi\u2019an, China. May 2016.<\/li><li>Thomas Winkler and Bernhard Rinner. <a href=\"https:\/\/bernhardrinner.com\/pubs\/2014\/Winkler_ACMComSurv2014.pdf\">Security and Privacy Protection in Visual Sensor Networks: A Survey.<\/a> <em>ACM Computing Surveys<\/em>, 47(1):pages 38, 2014.<\/li><li>Adam Erdelyi, Tibor Barat, Patrick Valet, Thomas Winkler and Bernhard Rinner. <a href=\"https:\/\/bernhardrinner.com\/pubs\/2014\/Erdelyi_AVSS2014.pdf\">Adaptive Cartooning for Privacy Protection in Camera Networks<\/a>. In <em>Proceedings of the IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS)<\/em>, Seoul, Korea. August 2014.<\/li><li>Thomas Winkler and Bernhard Rinner. <a href=\"https:\/\/bernhardrinner.com\/pubs\/2011\/Winkler_JWCN2011.pdf\">Securing Embedded Smart Cameras with Trusted Computing.<\/a> <em>EURASIP Journal on Wireless Communications and Networking<\/em>, Article ID 530354, 20 pages, 2011.<\/li><\/ul>\n<\/div><\/div>\n\n\n<p><!-- \/wp:post-content --><\/p>","protected":false},"excerpt":{"rendered":"<p>Sensors and in particular cameras have found their way into many parts of our daily lives. While monitoring public places is still a common use case for camera systems, applications in private environments are emerging. The ever growing number of cameras raises important questions concerning security and privacy. \u201cOur approach [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":18,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-6419","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/6419","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6419"}],"version-history":[{"count":25,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/6419\/revisions"}],"predecessor-version":[{"id":6674,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/6419\/revisions\/6674"}],"up":[{"embeddable":true,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/18"}],"wp:attachment":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6419"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}