{"id":6331,"date":"2020-08-31T12:14:23","date_gmt":"2020-08-31T12:14:23","guid":{"rendered":"http:\/\/new.bernhardrinner.com\/?page_id=6331"},"modified":"2023-04-20T10:35:46","modified_gmt":"2023-04-20T10:35:46","slug":"smart-camera-networks","status":"publish","type":"page","link":"https:\/\/bernhardrinner.com\/?page_id=6331","title":{"rendered":"Smart camera networks"},"content":{"rendered":"\n<p>Smart camera networks are real-time distributed embedded systems that perform computer vision using multiple cameras. They have emerged thanks to the simultaneous advances in four key disciplines: computer vision, image sensors, embedded computing, and sensor networks.<\/p>\n\n\n\n<p>\u201cWe aim at advancing this field of research by applying novel networking concepts as well as by developing various prototypes,\u201d Bernhard Rinner explains. Analyzing the captured data onboard the cameras and within the network in real-time is important to avoid transferring large volume of video data over the network. The strong resource limitations are challenging and require efficient algorithms and network management. The research team has developed various camera platforms and has deployed them in indoor and outdoor environments. Test applications include traffic monitoring, environmental monitoring, and surveillance.<\/p>\n\n\n\n<figure class=\"wp-block-gallery columns-3 is-cropped\"><ul class=\"blocks-gallery-grid\"><li class=\"blocks-gallery-item\"><figure><a href=\"https:\/\/pervasive.aau.at\/BR\/pubs\/2004\/Bramberger_RTAS2004.pdf\"><img loading=\"lazy\" decoding=\"async\" width=\"830\" height=\"343\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/1smartcam.png\" alt=\"\" data-id=\"6341\" data-full-url=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/1smartcam.png\" data-link=\"http:\/\/new.bernhardrinner.com\/?attachment_id=6341\" class=\"wp-image-6341\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/1smartcam.png 830w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/1smartcam-300x124.png 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/1smartcam-768x317.png 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/1smartcam-800x331.png 800w\" sizes=\"auto, (max-width: 830px) 100vw, 830px\" \/><\/a><figcaption class=\"blocks-gallery-item__caption\">Single-DSP prototype (2004)<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><a href=\"https:\/\/pervasive.aau.at\/BR\/pubs\/2006\/Bramberger_Computer2006.pdf\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"699\" src=\"http:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam-1024x699.jpg\" alt=\"\" data-id=\"6351\" data-full-url=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam.jpg\" data-link=\"http:\/\/new.bernhardrinner.com\/?attachment_id=6351\" class=\"wp-image-6351\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam-1024x699.jpg 1024w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam-300x205.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam-768x524.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam-800x546.jpg 800w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MultiDSP-smartcam.jpg 1064w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><figcaption class=\"blocks-gallery-item__caption\">Multi-DSP prototype (2006)<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><a href=\"https:\/\/bernhardrinner.com\/pubs\/2010\/Winkler_AVSS2010.pdf\"><img loading=\"lazy\" decoding=\"async\" width=\"896\" height=\"809\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustCam.jpg\" alt=\"\" data-id=\"6346\" data-full-url=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustCam.jpg\" data-link=\"http:\/\/new.bernhardrinner.com\/?attachment_id=6346\" class=\"wp-image-6346\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustCam.jpg 896w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustCam-300x271.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustCam-768x693.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustCam-800x722.jpg 800w\" sizes=\"auto, (max-width: 896px) 100vw, 896px\" \/><\/a><figcaption class=\"blocks-gallery-item__caption\">TrustCAM (2011)<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><a href=\"https:\/\/bernhardrinner.com\/pubs\/2013\/Khan_TECS2013.pdf\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"631\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MobyTrick-camera.jpg\" alt=\"\" data-id=\"6345\" data-full-url=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MobyTrick-camera.jpg\" data-link=\"http:\/\/new.bernhardrinner.com\/?attachment_id=6345\" class=\"wp-image-6345\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MobyTrick-camera.jpg 1024w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MobyTrick-camera-300x185.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MobyTrick-camera-768x473.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/MobyTrick-camera-800x493.jpg 800w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><figcaption class=\"blocks-gallery-item__caption\">Multi-sensor platform (2012)<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><a href=\"https:\/\/bernhardrinner.com\/pubs\/2014\/Winkler_AVSS2014.pdf\"><img loading=\"lazy\" decoding=\"async\" width=\"883\" height=\"677\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-Rasp.jpg\" alt=\"\" data-id=\"6348\" data-full-url=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-Rasp.jpg\" data-link=\"http:\/\/new.bernhardrinner.com\/?attachment_id=6348\" class=\"wp-image-6348\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-Rasp.jpg 883w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-Rasp-300x230.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-Rasp-768x589.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/TrustEYE-Rasp-800x613.jpg 800w\" sizes=\"auto, (max-width: 883px) 100vw, 883px\" \/><\/a><figcaption class=\"blocks-gallery-item__caption\">TrustEYE with host platform (2014)<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><a href=\"https:\/\/bernhardrinner.com\/pubs\/2016\/Haider_IOTPTS2016.pdf\"><img loading=\"lazy\" decoding=\"async\" width=\"933\" height=\"583\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam.jpg\" alt=\"\" data-id=\"6352\" data-full-url=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam.jpg\" data-link=\"http:\/\/new.bernhardrinner.com\/?attachment_id=6352\" class=\"wp-image-6352\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam.jpg 933w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam-300x187.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam-768x480.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/Zynq-smartcam-800x500.jpg 800w\" sizes=\"auto, (max-width: 933px) 100vw, 933px\" \/><\/a><figcaption class=\"blocks-gallery-item__caption\">Zynq-based SoC-platform (2017)<\/figcaption><\/figure><\/li><\/ul><figcaption class=\"blocks-gallery-caption\">Evolution of smart cameras&#8217; prototypes. The embedded processors range from DSPs (TMS320C64x) over OMAP and ARM processors to a system-on-chip platform (Zynq).<\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>In-network processing is concerned about the management of the available resources in the camera network. Examples of such resource management include <em>clustering<\/em>, i.e., selecting a group of cameras which jointly work a specific task, <em>handover<\/em>, i.e., transfering a specific task from one camera to another, and  <em>calibration<\/em>, i.e., estimating the spatial relationship among the individual cameras.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-28f84493 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\">\n<p>In her recent work, Jennifer Simonjan developed a decentralized and resource-aware algorithm for estimating the poses of all camera nodes without any user interaction. \u201cSelf-calibration is achieved in two steps,\u201d she explains. \u201cFirst, overlapping camera pairs estimate relative positions and orientations by exchanging locally measured distances and angles to detected objects. Second, calibration information of overlapping cameras is spread throughout the network such that poses of non-overlapping cameras can also be estimated.\u201d<\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:33.33%\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"814\" src=\"http:\/\/new.bernhardrinner.com\/wp-content\/uploads\/2020\/08\/VSN-calibration.jpg\" alt=\"\" class=\"wp-image-6371\" srcset=\"https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/VSN-calibration.jpg 1024w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/VSN-calibration-300x238.jpg 300w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/VSN-calibration-768x611.jpg 768w, https:\/\/bernhardrinner.com\/wp-content\/uploads\/2020\/08\/VSN-calibration-800x636.jpg 800w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Self-calibration determines the position and orientation of all camera nodes in the network.<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n<p>Bernhard Rinner and his team have been involved in smart camera research for more than 15 years. The following list documents some highlights of that period:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Co-initiation of the <em><strong>ACM\/IEEE International Conference on Distributed Smart Cameras<\/strong><\/em> (13th edition in 2019)<\/li><li>Co-editing (with W. Wolf) of a special issue on <a href=\"https:\/\/ieeexplore.ieee.org\/stamp\/stamp.jsp?tp=&amp;arnumber=4640962\">Distributed Smart Cameras<\/a> in the <a href=\"https:\/\/doi.org\/10.1109\/MC.2014.134\" data-type=\"URL\" data-id=\"https:\/\/doi.org\/10.1109\/MC.2014.134\">Proceedings of the IEEE<\/a><\/li><li>Various tutorial talks on smart cameras (e.g. <a href=\"http:\/\/pervasive.aau.at\/S5-tutorial\/\">Smart Cameras and Visual Sensor Networks<\/a> at the S5 spring school in Modena<\/li><li>Co-editing (with M. Reisslein and A. Roy-Chowdhury) of a special issue on <a href=\"https:\/\/doi.org\/10.1109\/MC.2014.134\">Smart Camera Networks<\/a> in <em><a href=\"http:\/\/ieeexplore.ieee.org\/xpl\/tocresult.jsp?isnumber=6818895\">IEEE Computer<\/a><\/em><\/li><li>Browse the relaunched first SmartCam website (@TUGraz) (now <a href=\"https:\/\/bernhardrinner.com\/smartcam\/\" data-type=\"URL\" data-id=\"https:\/\/bernhardrinner.com\/smartcam\/\">bernhardrinner.com\/smartcam<\/a>) and watch out for our first videos!<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Funded projects<\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Intelligent Vision Austria (ComVis)<\/strong><br>Co-principal investigator. Funding from Federal Ministry of Research and Austrian Institute of Technology, 2014-2019<\/li><li><a href=\"https:\/\/crosmos.aau.at\/\" data-type=\"URL\" data-id=\"https:\/\/crosmos.aau.at\/\">Cooperative, Resource-Optimization and Self-Organization in Mobile, Mixed-Reality Environments (CROSMOS)<\/a><br>Principal investigator. KWF, 2014-2015<\/li><li><strong>Self-organizing Multimedia Architecture (SOMA)<\/strong><br>Co-principal investigator. Funding from EU\/KWF\/BABEG, 2009-2012<\/li><li><strong>Closed-Loop Integration of Cognition, Communication and Control (CLIC)<\/strong><br>Co-Principal investigator. Funding from FFG, 2009-2010<\/li><li><strong>Autonomous Traffic Monitoring by Embedded Vision (EVis)<\/strong><br>Principal investigator. Funding from FFG, 2007-2010<\/li><\/ul>\n\n\n\n<div class=\"wp-block-group has-background\" style=\"background-color:#f0f0f0\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<h4 class=\"wp-block-heading\">Selected publications<\/h4>\n\n\n\n<ul class=\"wp-block-list\"><li>Jennifer Simonjan and Bernhard Rinner. <a href=\"https:\/\/doi.org\/10.1016\/j.adhoc.2019.01.007\">Decentralized and Resource-efficient Self-Calibration of Visual Sensor Networks.<\/a> <em>Ad Hoc Networks<\/em>, 2019.<\/li><li>C. Piciarelli, L. Esterle, A. Khan, B. Rinner, and G. L. Foresti. <a href=\"https:\/\/doi.org\/10.1109\/TCSVT.2015.2426575\"> Dynamic reconfiguration in camera networks: A short survey. <\/a><em>IEEE Transactions on Circuits and Systems for Video Technology<\/em>, 2016. <\/li><li> B. Rinner, L. Esterle, J. Simonjan, G. Nebehay, R. Pflugfelder, P. R. Lewis, and G. F. Dominguez. <a href=\"https:\/\/doi.org\/10.1109\/MC.2015.209\">Self-aware and self-expressive camera networks.<\/a> <em>IEEE Computer<\/em>, 2015. <\/li><li> C. Micheloni, B. Rinner, and G. L. Foresti. <a href=\"http:\/\/dx.doi.org\/10.1109\/MSP.2010.937333\">Video analysis in PTZ camera networks: From master-slave to cooperative smart cameras.<\/a><em> IEEE Signal Processing Magazine<\/em>, 2010. <\/li><li> B. Rinner and W. Wolf. <a href=\"http:\/\/dx.doi.org\/10.1109\/JPROC.2008.928742\">Introduction to distributed smart cameras.<\/a> In <em>Proceedings of the IEEE<\/em>, 2008. <\/li><li> M. Bramberger, A. Doblander, A. Maier, B. Rinner, and H. Schwabach. <a href=\"http:\/\/dx.doi.org\/10.1109\/MC.2006.55\">Distributed embedded smart cameras for surveillance applications.<\/a> <em>IEEE Computer<\/em>, 2006. <\/li><\/ul>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Smart camera networks are real-time distributed embedded systems that perform computer vision using multiple cameras. They have emerged thanks to the simultaneous advances in four key disciplines: computer vision, image sensors, embedded computing, and sensor networks. \u201cWe aim at advancing this field of research by applying novel networking concepts as [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":18,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-6331","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/6331","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6331"}],"version-history":[{"count":42,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/6331\/revisions"}],"predecessor-version":[{"id":7117,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/6331\/revisions\/7117"}],"up":[{"embeddable":true,"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=\/wp\/v2\/pages\/18"}],"wp:attachment":[{"href":"https:\/\/bernhardrinner.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6331"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}