VIDEOSORVEGLIANZA Profili sociologici, criminologici, culturali e giuridici nell’ottica smart city Milano 24 Maggio, Università Cattolica del Sacro Cuore VIDEOSORVEGLIANZA: LA RICERCA IN VISIONE ARTIFICIALE PER IL RICONOSCIMENTO AUTOMATICO DI PERSONE ED EVENTI Prof. Rita Cucchiara, Università di Modena e Reggio Emilia, Direttore del centro Softech ICT http://www.Imagelab.ing.unimore.it WELCOME IN MODENA The Second Short Spring School in Surveillance is organized by -University of Modena and Reggio Emilia -Softech-ICT Interdip. Research Center in ICT -Dipartimento di Ingegneria Enzo Ferrari - ImageLab Co-Sponsored by - Fondazione Cassa di Risparmio di Modena - GIRPR (Italian chapter of IAPR) Università di Modena e Reggio Emilia, Italy UNIMORE: WHERE WE ARE… Università di Modena e Reggio Emilia Emilia Romagna, Italia Dipartimento di Ingegneria “Enzo Ferrari” ImageLab Università di Modena e Reggio Emilia, Italy WHY S5? A research School in (computer vision and pattern recognition for) Video Surveillance. Mainly a school for researchers few hot selected topics Short (but intensive) school in Spring period A Second edition… Università di Modena e Reggio Emilia, Italy S4 THE 2011 EDITION Multicamera & applications Tracking Security and Forensics Face and expression Architecture and systems Large Crowd Università di Modena e Reggio Emilia, Italy AGAIN SURVEILLANCE… Why another (short spring) School in surveillance? Surveillance Surely is an industrial gold filed … is it still an open research problem? Università di Modena e Reggio Emilia, Italy THE MARKET The global Intelligent Video Surveillance (IVS) & Video Analytics (VA) industry revenues* • totaled $13.5 billion in 2012, • and are estimated to reach $39 billion in 2020. The rapid market growth is driven by the following dynamics: • Increased use of video surveillance. • Migration from analog to digital cameras and to IP based cameras. • Technology maturity. Video analytics algorithms, processors, applications and products underwent a decade of technological evolution to intelligent video processing, based on advancements in image processing, enabling automatic detection of signatures detection and identification. • Cost reduction of video analytic systems. Driven by the falling prices of image processing DSPs and communication systems. Cost-performance of new edge-based video analytics DSP technologies (e.g., Intel, Texas Instruments DSPs). Università di Modena e Reggio Emilia, Italy From the "Intelligent Video Surveillance, VCA & Video Analytics: Technologies & Global Market – 2013-2020" THE MARKET Human operators entail high cost & high rate of overlooked events. Real time analysis of video images and recorded footage is a need that can hardly be answered effectively by human operators, and manpower cost. Furthermore, human operators fatigue and boredom cause a high rate of overlooked events. It takes IVS, VCA and VA to process trillions of video surveillance-hours generated annually. By 2011 over 165 million video surveillance cameras installed worldwide captured 1.4 trillion video-hours. the investing growth of 9-11% year , captured video surveillance will reach approximately 3.3 Trillion video-hours in 2020. A hypothetical analysis assuming that 20% of the most critical video stream should have been reviewed by human operators, results in a (hypothetical) need to employ (by 2011) a workforce of over 100 million operators (working 8 hours daily, 300 days a year). Intelligent video surveillance and video analytics with mature technology have attracted a lot of attention. ---the global market* will triple by 2020. Università di Modena e Reggio Emilia, Italy THE RESEARCH 1998 the first workshop on AVSS (advanced video-based surveillance system) in Genoa 2000 The first IEEE Transaction PAMI Special issue on video surveillance 2003 the first IEEE conference AVSS ….. FIFTTEEN YEARS OF RESEARCH Università di Modena e Reggio Emilia, Italy SOME STATISTICS “Video Surveillance” : Google scholar 54000 items, IEEEXplore 6407 items 140 from IEEEXplore papers with “video surveillance” keyword 120 100 80 conf (x 10) journals 60 40 20 surveillance analytics 2010 863 23 2011 867 27 2012 768 46 0 1989-1999 2000 2002 2004 2006 2008 2010 2012 Università di Modena e Reggio Emilia, Italy STATISTICS IEEE conference papers with video surveillance and …… 400 2004 350 2006 300 250 2008 2010 2012 200 150 100 50 0 Università di Modena e Reggio Emilia, Italy STATISTICS IEEE journal papers with video surveillance and …… 45 40 35 30 25 20 2004 2006 15 2008 10 2010 5 2012 0 Università di Modena e Reggio Emilia, Italy SURVEILLANCE 1) A growing interest in PEOPLE surveillance 2010 2011 2012 traffic 117 104 86 people 83 85 93 2) From SECURITY to SOCIAL and WELLBEING 3) A research interest in computer vision AND learning Università di Modena e Reggio Emilia, Italy Acquisition Single camera Multiple cameras Detection VIDEO SURVEILLANCE Moving object detection Single object/people Multiple targets, cluttered, occluded.. Tracking 2000 RESEARCH Linear prediction Generative models Stocastic prediction Understanding Purposive Università di Modena e Reggio Emilia, Italy Acquisition Detection & Tracking SPATIO-TEMPORAL REASONING 2010 RESEARCH PEOPLE SURVEILLANCE IN THE NEW DECADE Learning & Inferring BIG DATA ANALYSIS Searching & Recognizing HUMAN FEEDBACK Università di Modena e Reggio Emilia, Italy PEOPLE ANALYSIS IS PERVASIVE From Security a) Surveillance: Real time detection, Border, Zone control, Activity monitoring, Traffic, urban control… b) Safety: traffic-automotive control; crowd monitoring, home, working area control c) Forensics: Video Mining, Identity assessment, Likelihood ratio support To Multimedia Video analysis, broadcasting analysis, Digital Library annotation, Sport action recognition, Human Interaction, Gaming To (Social) Wellbeing Retail analysis, Comfort in architecture Design, Building Automation, Healthcare, Entertainment, Graphics.. Università di Modena e Reggio Emilia, Italy PEOPLE ANALYSIS Many applications.. Same problem: detect people, their identity and behavior Università di Modena e Reggio Emilia, Italy PEOPLE SURVEILLANCE: WHAT AT IMAGELAB Detection &Tracking People (and crowd) Detection and Tracking With multisensory data Learning& inferring People Identification and (Ri-)Identification Search & Recognition People Search by similarity A-priori Models Visual Learning Università di Modena e Reggio Emilia, Italy SURVEILLANCE AT S5 The topics: Ci penso io quando avro’ gli abstract Università di Modena e Reggio Emilia, Italy SURVEILLANCE AT S5 The lecturers: •Arnold Smeulders CWI Amsterdam, the Netherlands •Bernhard Rinner Alpen-Adria-Universität Klagenfurt, Austria •Francois Bremond INRIA, France •Greg Mori Simon Fraser University, Canada Università di Modena e Reggio Emilia, Italy SURVEILLANCE AT S5 The lecturers: •Horst Bischof Institute for Computer Graphics and Vision, Inffeldgasse Graz, Austria •Larry Davis Institute for Advanced Computer Studies, Univ. of Maryland, USA •Shmuel Peleg The Hebrew University of Jerusalem, Israel Università di Modena e Reggio Emilia, Italy SURVEILLANCE AT S5 The attendees Participant Affiliation 24% Company Research Center 58% 18% Participant Nation University 3% 14%4% 3% 14% Attendees type Austria Denmark Israel Italy 62% Spain Sweden 17% 13% 27% 43% Company Msc Student Phd Student Researcher Università di Modena e Reggio Emilia, Italy THANKS.. Prof. Rita Cucchiara Dipartimento di Ingegneria Enzo Ferrari Res. Center SOFTECH-ICT Università degli Studi di Modena e Reggio Emilia [email protected] Imagelab Andrea Prati [IUAV-Venezia] Costantino Grana Roberto Vezzani Simone Calderara http://imagelab.ing.unimo.it Giovanni Gualdi , Paolo Piccinini, Daniele Borghesani, Adnan Rashid, Paolo Santinelli Davide Baltieri , Dalia Coppi, Michele Fornaciari ,Marco Manfredi VISION-E srl Rudy Melli, Giuliano Pistoni, Emanuele Perini