Intelligent situation awareness

Project Profile
SPY
Intelligent situation awareness
Speeding wireless situation awareness and
rescue monitoring, intervention and control
•••••••••••••••••••••••••••••••••••••
The SPY (Surveillance imProved System)
project is creating an automated,
intelligent surveillance and rescue
framework adapted to the mobile
environment. The new framework
will improve the use of wireless
infrastructures and mobile sensors to
help professional end users in the field,
including the police and fire brigades
in their surveillance and rescue tasks.
SPY will exploit existing applications
and advanced customised algorithms
to provide the most comprehensive
aggregated picture and automated
decision support for a faster and more
effective monitoring, intervention and
control of unpredictable situations. The
final experimentation of the project will
be carried out with end users in a closeto-real situation.
Situational awareness is critical for law
enforcement in complex, highly dynamic
environments. State and local authorities
– and particularly the police and fire
brigades – need trustworthy and reliable
information through richer media resources
to help them in their day-to-day-missions.
supplied to operators in the field.
In the near future, control rooms will
increasingly share quantities of information
using richer media such as video and audio
with metadata, enabling those in the field to
have smart situational awareness.
However all this requires new multicamera surveillance techniques, new
data-integration methods and timely
communication of the information together
with suitable mobile and multi-sensor
platforms.
EMBEDDED INTELLIGENT SOLUTIONS
SPY will develop a new framework adapted
to the mobile environment that requires
optimised transmission and distributed
intelligence. The mobile aspect implies the
definition of embedded intelligent solutions
to minimise the amount of information to
be transmitted over the wireless networks.
It will offer discrimination in field services
depending on the situation detected – such
as stolen objects, behaviour, tracking and
identification.
(ITEA 2 ~ 09025)
•••••••••••••••
nPartners
ACIC
ARC Informatique
ASELSAN
C2Tech
Cassidian
CogVis Software and Consulting
ENSTA-ParisTech
Institute of Fundamental Electronics
Institut TELECOM
Kilosoft
EOLANE
MIRASYS
Multitel
Pôle Pilote de Sécurité Locale
Roger-GPS
VTT Technical Research Centre of
Finland
nCountries involved
Austria
Belgium
Finland
France
Turkey
nProject start
January 2011
nProject end
December 2013
The ITEA 2 project will address these
concerns by adapting and extending
A new generation of intelligent surveillance
state-of-the-art algorithms already existing
nContact
– the automated wide-area system – is set
on personal computers to mobile and
to improve significantly the way information
unpredictable contexts. A rules engine
Project Leader :
EkoT Belgium
sprl, Roux-Miroir,
Belgium ● Tel.: +32 10
88 14
● Fax: +32 10
88 be
99 15
● email:to
[email protected]
● www.ekot.eu.com
is shared between
control
rooms and
and
an38ontology
will
added
these
Eric Munier, Cassidian
Fix Surveillance
System
Email :
[email protected]
Wired CCTV
SPY scope
Global Surveillance
System
Wireless Network
Mobile Surveillance Systems
SPY solution overview
Figure 1: Solution overview
Project Profile
ITEA 2 Office
EkoT Belgium sprl, Roux-Miroir, Belgium ● Tel.: +32 10 88 14 38 ● Fax: +32 10 88 99 15 ● email: [email protected] ● www.ekot.eu.com
WP4 : SPY
context and
GPS
component
that take in and stream surveillance
information while insuring scalability
and interoperability between equipment
from different sources.
WP5 SPY network
Complex Event
Detection
knowledge
component
Light
Database
(Ontology)
Data coding
techniques
Micro
Event
detection
Audio
Fusion/Correlation
Application
Manager
Integrity
techniques
recognition
Camera
Video
Transmission
adaptation
techniques
recognition
Remote
control
Smart Mobile
Open platfrm
WP6 Mobile interaction
REAL END-USER INVOLVEMENT
The mobile wireless surveillance solution
will be demonstrated in a real user urban
environment: with the help of final end
users – Belgian, French and Turkish police
and cities.
Recorder/streaming
server
Outcomes expected include:
n Advanced video analysis, such as
Figure 2: SPY mobile system graphical breakdown
car number plate recognition, object
SPY mobile system graphical WBS description
COMMON SURVEILLANCE FRAMEWORK
recognition, movement analysis and
To develop a common surveillance framework adapted to mobile environments, SPY will
use advanced video-analysis techniques designed for mobile and harsh situations.
abnormal-situation detection in mobile
Context sources will be intentionally restricted to video sensors embedded in a vehicle,
but the framework developed will allow extension to other kinds of sensors.
and unpredictable contexts such as
algorithms
to form a stand-alone software
Advanced adaptive-coding, compression, error-resilience and error-concealment
aggression, fire and crowd formation,
core
able
detect,
and
act over wireless
techniques
will beto
used
to improveunderstand
transmission and save
bandwidth
networks. Distributed intelligence and decision-making capabilities will be developed,
including data
fusion, analysis and ranking of alarms. Video/image transmission security
will be integrated in the patrol vehicle.
during
events.
will be improved through a combination of authentication, integrity and encryption
mechanisms.
This will also be used to trigger alarms
Expected
results include
definition
of:
or live streaming to save network
In
addition,
SPY
will
define
and
implement
 Surveillance ontology with data and metadata models to identify situational
representation;
and to ensure integrity, adaptive
bandwidth when nothing important is
a new
protocol
New metadata protocols enabling the industry to build components that take in and
stream surveillanceand
information
while insuring scalability
and interoperability between
happening;
compression
encapsulation
of
metadata
equipment from different sources.
to provide the trusted and interoperable
n New certification techniques which
wireless media needed in such
enable surveillance information to be
environments. A secondary objective is to
used for evidence;
define a new adaptive interaction solution
n Advanced adaptive video-coding,
to present users with a comprehensive and
error-resilience, error-concealment
intuitive picture of the incident adapted to
and transport techniques for bandwidth
their environment.
optimisation over WiMAX, long-term
evolution (LTE) mobile phone and other
wireless IP networks;
COMMON SURVEILLANCE FRAMEWORK
To develop a common surveillance
n Recorded videos in a vehicle will be
framework adapted to mobile environments,
transferred to the control room using
SPY will use advanced video-analysis
either non-real-time video streaming
techniques designed for mobile and
or a reliable transmission method such
harsh situations. Context sources will be
as file transfer, ensuring that virtually
intentionally restricted to video sensors
lossless video can be sent back to the
embedded in a vehicle, but the framework
control room;
developed will allow extension to other
n Remote pan/tilt/zoom control for mobile
kinds of sensors.
cameras and to trigger and program
specific behaviour or events – enabling
Advanced adaptive-coding, compression,
users in the vehicle or control room to
error-resilience and error-concealment
have full access to all camera data; and
techniques will be used to improve
n Provision of a relevant operational
transmission and save bandwidth over
picture to users by offering an adapted
wireless networks. Distributed intelligence
man-machine interface in the mobile
and decision-making capabilities will be
environment with rich and intuitive
developed, including data fusion, analysis
display at control-room level.
and ranking of alarms. Video/image
transmission security will be improved
GLOBAL AND DETAILED AWARENESS
through a combination of authentication,
SPY is set to demonstrate real advances
integrity and encryption mechanisms.
in surveillance capabilities illustrating how
Expected results include definition of:
the end-users can obtain global situation
awareness with a large coverage and
n Surveillance ontology with data and
still detailed view. The concepts could
metadata models to identify situational
also apply to other markets such as
representation; and
traffic management and industrial safety
n New metadata protocols enabling
management.
the industry to build components
Wireless IP Network
Display
High Tech Campus 69 - 3
5656 AG Eindhoven
The Netherlands
Tel
: +31 88 003 6136
Fax
: +31 88 003 6130
Email :[email protected]
Web :www.itea2.org
n ITEA 2 – Information Technology
for European Advancement – is
Europe’s premier co-operative R&D
programme driving pre-competitive
research on embedded and
distributed software-intensive systems
and services. As a EUREKA strategic
Cluster, we support co-ordinated
national funding submissions and
provide the link between those who
provide finance, technology and
software engineering. Our aim is to
mobilise a total of 20,000 personyears over the full eight-year period of
our programme from 2006 to 2013.
Printed by: Kay Jeunhomme on 4/3/11 09:57 Last Saved: 4/3/11 09:57
Page 3 of 5
File location: S:\ITEA2\ITEA communications\Project Profiles-Project Results\Leaflets_2011\Word files\PP\SPY\SPY-profile-outITEA2 (3-3-11)_KJ.docx
n ITEA 2-labelled projects are
industry-driven initiatives building
vital middleware and preparing
standards to lay the foundations
for the next generation of products,
systems, appliances and services.
Our programme results in real product
innovation that boosts European
competitiveness in a wide range of
industries. Specifically, we play a key
role in crucial application domains
where software dominates, such as
aerospace, automotive, consumer
electronics, healthcare/medical
systems and telecommunications.
n ITEA 2 projects involve
complementary R&D from at least two
companies in two countries. We issue
annual Calls for Projects, evaluate
projects and help bring research
partners together. Our projects are
open to partners from large industrial
companies and small and mediumsized enterprises (SMEs) as well
as public research institutes and
universities.
SPY
(ITEA 2 ~ 09025)
October 2011