How can blind get Information in Public Transports using PDA? The

How can blind get Information in
Public Transports using PDA?
The RAMPE Auditive Man Machine
Interface
G. Baudoin, O. Venard, Y. Benabou - ESIEE
G. Uzan, A. Rousseau – LEI Paris 5
A. Paumier, J. Cesbron - LUMIPLAN
2
3
4
Because of management reasons, please use the
other stop point (in front of the "crédit
immobilier")
5
Research objectives and
partners, PREDIT project
Design, develop and
experiment
Complementary Partners
ESIEE : project coordinator
An active and interactive
system for the assistance and
auditive information of
passengers
Specially designed for blinds
and visually impaired people,
Intended to equip stop points
(bus or tramway) in public
transports
• Information and communication
Technologies
• Application on the PDA.
LEI, university Paris 5
• MMI Ergonomics.
• Knowledge of handicap.
LUMIPLAN
• Transport Information Systems.
• Application at the stop-point.
6
Project Structure
Phase 1 : from analysis of the needs and
specifications to the realization and technical
assessment of prototypes
T0 = 5 january 2004
Phase 2 : In situ implementation and evaluations
7
Uncertainty in bus
networks
Bus is more difficult to use than metro or train
because of the multiplicity of causes of
uncertainties:
Presence and localization of stops,
Multiplicity of infrastructure configurations,
Multiplicity of possible types of perturbations and of
possible exploitation answers,
Vulnerability to traffic contingencies, ....
8
Principal concerns for
blind people
Security: avoid risks of falls and collisions
Localizations:
• Of the person in an abstract journey (numbers, directions, name of
correspondences or stops)
• Of multiple pieces of equipment and threshold crossed to access to
a vehicle
Reliability: difference between the mental representation of
a person and his real situation during the journey.
9
Spatial and temporal
formalization
By formalizing:
the moving in four spatial zones and
the diffusion of information in three level of temporality,
we locate
in space and time the requirements in information putting
in adequacy the user concerns and the diversity of
situations.
10
4 spatial zones in public
transports
Zone 1 : urban open zone
Need of localization information: existence and location of
In the case of bus zone 2 and 3
stops
are merged.
Zone 2 : transfer zone
need of guiding information
Zone 3 : access zone
To reconstitute a virtual
access zone is one objective
of RAMPE.
need of factual information such as arrival of a bus
Zone 4 : inside vehicle
need of information about changes in the environment.
11
Information diffusion
3 kinds of temporality
Structural
Line numbers and names at the stop point,
timetables, contextual information.
theoretical
Short term
this kind of information can be seen as stable exceptions
such as service interruption due to works along the journey,
valid for a few days or weeks.
Real-time
real-time information like sudden service break because of
strike or accident, vehicle arrival, service messages.
12
Architecture of RAMPE
« R - Les Marceaux,
in 15 minutes »
Speech Synthesis
Command
interface
Delivered
Informations:
Timetables
Journeys
Events
Events:
Line modified
Bus approaching
Radio Perturbations
WiFi radion link
PDA with WIFI
Bus stop
Tour de comm.
Central Server
13
Database:
Passenger
Informations
XML
GPS Coordinates
Blind person in the
street
Periodical Identification of the stops
The PDA indicates presence of stops
and lists them
14
Approach of the chosen
stop
The user chooses a stop.
Connection of the PDA to the chosen stop.
15
Approach of the chosen
stop
Sound signaling the position of
the stop
Ding
Dong!
16
Guiding towards the stop
The user determines the position
of the stop thanks to the sound.
The loudspeaker can be remotely
reactivated (twice) by double click
17
Again!
After connection at the
stop, Loading of the
Database
Loading of the database
18
Navigation Scenario
« CROUS
212 (pointe de Champs,dans 5 min)
213 (place Gasnier Guy, dans 12 min)
312 (Chelles Gournay, dans 7 min)* »
Noisy Champs RER
Bus stop sends a
message for DB
update
PDA Downloads DB
PDA plays a warning
sound
CROUS
Mairie de Champs *
Place Churchill
Chelles Gournay
Generic Messages
NO
Mairie de Champs
Ack in 3s
Les Iris
YES
Place Churchill
Come back to the
initial context
Rue du Port
Avenue Des Martyrs
Chelles Gournay
19
Vocal loop
Vocal loop
Vocal loop
ACK
Level 1
Vocal loop
ACK
Level 2
Level 3
ACK
Zooming effect: from high level information to details.
20
Auditive Interfaces
Appreciated by the VIP,
but a simple auditive conversion of visual information can
loose any effectiveness and even become awkward or
generator of risks;
Sound diffusion is intrinsically fleeting, sequential and
potentially intrusive.
21
Feedback and robustness
for auditive interface
To be effective during the trip, the interface must:
have a feedback making it possible to synchronize the diffusion, the
attention and the active listening, in a dynamically changing
environment.
be robust to avoid that the user or the application get lost.
• It must update as well as possible and at the right time the mental
representation of the VIP situation in its trip.
• It must minimize the mental load,
• handle errors,
• control and maintain selectively the transmission and memory of
information in a dynamically contingent space (VIP mobility, radio variability,
threshold effects ...).
22
3 States of
interactionsof the MMI
The application can be in 3 states of interaction:
Idle mode, task execution mode, vocal loop mode
In idle or task excecution modes, only 2 possibilities:
• Do nothing or wait
• Select and/or interrupt
In vocal loop mode, the user can:
• Skip from one stage to the next one
• Reverse the vocal loop,
• Switch on pause or silent mode idle mode.
– He will only receive urgent messages.
23
Technical elements of
the MMI
• Speech Synthesis: Sayso PocketSpeech, from Acapela
• Command Interface: PDA keys
Stop of
RAMPE
Aknowledge
Silence
Urgent Mode
{
{
Normal Mode
Dynamic handling of
the keyboard: depends
on the application
state.
Acknowledge
Acknowledge Acknowledge
Acknowledge
24
Acknowledge
TIS and data available at
the stop
TIS Processor
GPS coordinates
Com. tower
Timetables
Geographical data,
visu@bus
25
XML structuration of
information
26
End of phase 1
PDA with RAMPE
application
WiFI
Speech Synthesis
Personnalisée
Information
Robust IHM
Automatique
Configuration
Self-adaption to TIS
Borne Horus Lumiplan
Embedded PCProcessor
WiFi Access-Point
External loud speaker
RF Receiver for radio
remote-control
Speech synthesis
software
Remote control
2 Push buttons
Loud-speaker
27
Conclusion – Preparation
of phase 2
Phase 1 finished:
Prototypes have been realized and technically validated.
The choice of non specific technologies: standard PDA, WiFi, XML will
facilitate the deployment of the system and the interaction with other
services.
Preparation of phase 2 : contacts with official authorities
and public transport networks to elaborate the project of
in situ experimentation.
The standardization aspects will be studied.
The objective is to obtain at the end of the project an operational
system that will installed by cities.
28
Publications, conferences
J. El Sayah, G. Baudoin, O. Venard, B. El Hassan, “Simulation using OMNet++
of the RAMPE system - an Interactive Auditive Machine helping blinds in
Public Transports“, Proc. Conference IEEE EUROCON 2005, Belgrade,Serbie
et Montenegro, Nov. 2005.
G. Baudoin, O. Venard, G. Uzan, A. Rousseau, Y. Benabou, A. Paumier, J.
Cesbron, “How can blinds get information in Public Transports using PDA? The
RAMPE Auditive Man Machine Interface”, Proc. 8th European Conference for
the advancement of assistive technology in Europe, aaate 2005, Lille, Sept.
2005
G. Baudoin, O. Venard, G. Uzan, A. Rousseau, Y. Beanbou, A. Paumier,
J.Cesbron“ The RAMPE Project: Interactive, Auditive Information System for
the Mobility of Blind People in Public Transports”, Proc. The 5th international
conference on ITS telecommunications, Brest Juin 2005
G. Baudoin, O. Venard, G. Uzan, A. Paumier, J. Cesbron,“ Le projet RAMPE,
Système interactif d’information auditive pour la mobilité des personnes
aveugles dans les transports publics”, Proc. Deuxième journée francophone
mobilité et ubiquité, ubimob’2005, Grenoble, Juin 2005
29
Contacts
ESIEE
LUMIPLAN SAS
LEI
G. Baudoin,
O.Venard
℡ : 01.45.92.66.46
fax : 01.45.92.66.99
J. Cesbron,
A. Paumier
℡ : 02.40.92.15.43
fax : 02.40.92.35.43
G. Uzan
[email protected]
[email protected]
[email protected]
ESIEE
2 Bd Blaise Pascal, BP 99
93162 Noisy le Grand
Cedex
LUMIPLAN SAS
Impasse Augustin Fresnel
ZA Du Moulin Neuf
44815 Saint Herblain
Université de Paris 5
LEI
45 rue des St Pères
30
℡ : 01.42.86.21.34
fax : 01 42 96 18 58
75270 Paris cedex 06