Intelligent situation awareness
Transcription
Intelligent situation awareness
Project Profile SPY Intelligent situation awareness Speeding wireless situation awareness and rescue monitoring, intervention and control ••••••••••••••••••••••••••••••••••••• The SPY (Surveillance imProved System) project is creating an automated, intelligent surveillance and rescue framework adapted to the mobile environment. The new framework will improve the use of wireless infrastructures and mobile sensors to help professional end users in the field, including the police and fire brigades in their surveillance and rescue tasks. SPY will exploit existing applications and advanced customised algorithms to provide the most comprehensive aggregated picture and automated decision support for a faster and more effective monitoring, intervention and control of unpredictable situations. The final experimentation of the project will be carried out with end users in a closeto-real situation. Situational awareness is critical for law enforcement in complex, highly dynamic environments. State and local authorities – and particularly the police and fire brigades – need trustworthy and reliable information through richer media resources to help them in their day-to-day-missions. supplied to operators in the field. In the near future, control rooms will increasingly share quantities of information using richer media such as video and audio with metadata, enabling those in the field to have smart situational awareness. However all this requires new multicamera surveillance techniques, new data-integration methods and timely communication of the information together with suitable mobile and multi-sensor platforms. EMBEDDED INTELLIGENT SOLUTIONS SPY will develop a new framework adapted to the mobile environment that requires optimised transmission and distributed intelligence. The mobile aspect implies the definition of embedded intelligent solutions to minimise the amount of information to be transmitted over the wireless networks. It will offer discrimination in field services depending on the situation detected – such as stolen objects, behaviour, tracking and identification. (ITEA 2 ~ 09025) ••••••••••••••• nPartners ACIC ARC Informatique ASELSAN C2Tech Cassidian CogVis Software and Consulting ENSTA-ParisTech Institute of Fundamental Electronics Institut TELECOM Kilosoft EOLANE MIRASYS Multitel Pôle Pilote de Sécurité Locale Roger-GPS VTT Technical Research Centre of Finland nCountries involved Austria Belgium Finland France Turkey nProject start January 2011 nProject end December 2013 The ITEA 2 project will address these concerns by adapting and extending A new generation of intelligent surveillance state-of-the-art algorithms already existing nContact – the automated wide-area system – is set on personal computers to mobile and to improve significantly the way information unpredictable contexts. A rules engine Project Leader : EkoT Belgium sprl, Roux-Miroir, Belgium ● Tel.: +32 10 88 14 ● Fax: +32 10 88 be 99 15 ● email:to [email protected] ● www.ekot.eu.com is shared between control rooms and and an38ontology will added these Eric Munier, Cassidian Fix Surveillance System Email : [email protected] Wired CCTV SPY scope Global Surveillance System Wireless Network Mobile Surveillance Systems SPY solution overview Figure 1: Solution overview Project Profile ITEA 2 Office EkoT Belgium sprl, Roux-Miroir, Belgium ● Tel.: +32 10 88 14 38 ● Fax: +32 10 88 99 15 ● email: [email protected] ● www.ekot.eu.com WP4 : SPY context and GPS component that take in and stream surveillance information while insuring scalability and interoperability between equipment from different sources. WP5 SPY network Complex Event Detection knowledge component Light Database (Ontology) Data coding techniques Micro Event detection Audio Fusion/Correlation Application Manager Integrity techniques recognition Camera Video Transmission adaptation techniques recognition Remote control Smart Mobile Open platfrm WP6 Mobile interaction REAL END-USER INVOLVEMENT The mobile wireless surveillance solution will be demonstrated in a real user urban environment: with the help of final end users – Belgian, French and Turkish police and cities. Recorder/streaming server Outcomes expected include: n Advanced video analysis, such as Figure 2: SPY mobile system graphical breakdown car number plate recognition, object SPY mobile system graphical WBS description COMMON SURVEILLANCE FRAMEWORK recognition, movement analysis and To develop a common surveillance framework adapted to mobile environments, SPY will use advanced video-analysis techniques designed for mobile and harsh situations. abnormal-situation detection in mobile Context sources will be intentionally restricted to video sensors embedded in a vehicle, but the framework developed will allow extension to other kinds of sensors. and unpredictable contexts such as algorithms to form a stand-alone software Advanced adaptive-coding, compression, error-resilience and error-concealment aggression, fire and crowd formation, core able detect, and act over wireless techniques will beto used to improveunderstand transmission and save bandwidth networks. Distributed intelligence and decision-making capabilities will be developed, including data fusion, analysis and ranking of alarms. Video/image transmission security will be integrated in the patrol vehicle. during events. will be improved through a combination of authentication, integrity and encryption mechanisms. This will also be used to trigger alarms Expected results include definition of: or live streaming to save network In addition, SPY will define and implement Surveillance ontology with data and metadata models to identify situational representation; and to ensure integrity, adaptive bandwidth when nothing important is a new protocol New metadata protocols enabling the industry to build components that take in and stream surveillanceand information while insuring scalability and interoperability between happening; compression encapsulation of metadata equipment from different sources. to provide the trusted and interoperable n New certification techniques which wireless media needed in such enable surveillance information to be environments. A secondary objective is to used for evidence; define a new adaptive interaction solution n Advanced adaptive video-coding, to present users with a comprehensive and error-resilience, error-concealment intuitive picture of the incident adapted to and transport techniques for bandwidth their environment. optimisation over WiMAX, long-term evolution (LTE) mobile phone and other wireless IP networks; COMMON SURVEILLANCE FRAMEWORK To develop a common surveillance n Recorded videos in a vehicle will be framework adapted to mobile environments, transferred to the control room using SPY will use advanced video-analysis either non-real-time video streaming techniques designed for mobile and or a reliable transmission method such harsh situations. Context sources will be as file transfer, ensuring that virtually intentionally restricted to video sensors lossless video can be sent back to the embedded in a vehicle, but the framework control room; developed will allow extension to other n Remote pan/tilt/zoom control for mobile kinds of sensors. cameras and to trigger and program specific behaviour or events – enabling Advanced adaptive-coding, compression, users in the vehicle or control room to error-resilience and error-concealment have full access to all camera data; and techniques will be used to improve n Provision of a relevant operational transmission and save bandwidth over picture to users by offering an adapted wireless networks. Distributed intelligence man-machine interface in the mobile and decision-making capabilities will be environment with rich and intuitive developed, including data fusion, analysis display at control-room level. and ranking of alarms. Video/image transmission security will be improved GLOBAL AND DETAILED AWARENESS through a combination of authentication, SPY is set to demonstrate real advances integrity and encryption mechanisms. in surveillance capabilities illustrating how Expected results include definition of: the end-users can obtain global situation awareness with a large coverage and n Surveillance ontology with data and still detailed view. The concepts could metadata models to identify situational also apply to other markets such as representation; and traffic management and industrial safety n New metadata protocols enabling management. the industry to build components Wireless IP Network Display High Tech Campus 69 - 3 5656 AG Eindhoven The Netherlands Tel : +31 88 003 6136 Fax : +31 88 003 6130 Email :[email protected] Web :www.itea2.org n ITEA 2 – Information Technology for European Advancement – is Europe’s premier co-operative R&D programme driving pre-competitive research on embedded and distributed software-intensive systems and services. As a EUREKA strategic Cluster, we support co-ordinated national funding submissions and provide the link between those who provide finance, technology and software engineering. Our aim is to mobilise a total of 20,000 personyears over the full eight-year period of our programme from 2006 to 2013. Printed by: Kay Jeunhomme on 4/3/11 09:57 Last Saved: 4/3/11 09:57 Page 3 of 5 File location: S:\ITEA2\ITEA communications\Project Profiles-Project Results\Leaflets_2011\Word files\PP\SPY\SPY-profile-outITEA2 (3-3-11)_KJ.docx n ITEA 2-labelled projects are industry-driven initiatives building vital middleware and preparing standards to lay the foundations for the next generation of products, systems, appliances and services. Our programme results in real product innovation that boosts European competitiveness in a wide range of industries. Specifically, we play a key role in crucial application domains where software dominates, such as aerospace, automotive, consumer electronics, healthcare/medical systems and telecommunications. n ITEA 2 projects involve complementary R&D from at least two companies in two countries. We issue annual Calls for Projects, evaluate projects and help bring research partners together. Our projects are open to partners from large industrial companies and small and mediumsized enterprises (SMEs) as well as public research institutes and universities. SPY (ITEA 2 ~ 09025) October 2011