Offre de partenariat – programme Horizon 2020 Détails de l`appel à

Offre de partenariat – programme Horizon 2020
Une entreprise autrichienne spécialisée dans la production d’information accessible pour les
personnes sourdes recherche des partenaires pour soumettre une proposition de projet Horizon
2020. L’entreprise a développé un système de traduction semi-automatique du langage parlé et
écrit vers le langage des signes. L’objectif du projet est de produire des vidéos basées sur des
avatars pour différentes applications comme le web ou la télévision. Ils recherchent des
développeurs logiciels, des studios d’animation, des instituts de recherche en intelligence
artificielle et des instituts de langue des signes pour compléter le consortium.
Détails de l’appel à propositions
H2020 ICT 19 2015 : Technologies of creative industries, social media and convergence.
Deadline de l’appel à proposition : 14 avril 2015/ Deadline pour manifester un intérêt : 17/02/15
Financement : 100% des dépenses (Research and Innovation Action)
http://bit.ly/1kvxYtx
Le projet
In order to provide accessible information to deaf people, written and spoken content needs to be
translated into sign language. As deaf people cannot hear spoken language, written text as an
abstract form of spoken language is very hard to understand for them. Consequently, subtitles are
also not an adequate solution, only translations in sign language are fully accessible to deaf people.
Today, translations into sign language are recorded in a studio and presented as videos showing an
interpreter signing the translation. These videos can then be integrated in websites or in-screen in a
movie or TV broadcast.
The current production of translations into sign language by recording in a studio is very expensive
and time-consuming, which is limiting the engagement for translations of institutions distributing
information (like public service broadcastings, authorities and private enterprises). At the same
time, particularly the requirement for accessibility concerning citizen information, is becoming
stricter.
The Austrian company has developed a high-quality semi-automatic translation system which
addresses the problems mentioned.
The main objective of the project to be submitted is the generation of intelligent methods and tools
in the context of avatar based video production for various applications.
The following research questions/technologies and their demonstrations will be part of the
envisaged project:
 Motion Capturing
 Pattern recognition in “movie data”
 Image processing/rendering
 Transition algorithms
 Automatic character design
 Improvement Learning Systems
 Improvement of prosody of the translation
Type de partenaire recherché
Type of partner(s) sought:
- Studios for animation (films) and motion capturing
- Institutes for sign language (university, linguistic)
- Research Institute for Artificial Intelligence specialised on language technologies
- Software developer
- End customers of the creative industries e.g. television station, animation studio
The partners should be able to cover one or preferably several of the requested fields of
expertise:
- motion capturing technologies
- animated film and video production and rendering
- pattern recognition
- learning IT-Systems
- in avatar technology
- in database technology
- in statistical methods
- in semantic methods
- in the animation software Maya
- in the computer language Phyton
- in sign language linguistic including prosody of sign language
Description of work to be carried out by the partner(s) sought:
Motion Capturing
Development of a complete system (software and hardware components) to
- create motions by motion capturing
- transfer these motions to an existing rig for further operations.
Important is high precision in regard of hand movements (detailed capability of expression of
hand orientation including finger movements).
Pattern recognition in “movie data”
Enable the automatic comparison of movements (sign language sings) in video films and
animated films. The goal is to identify similar movements. The comparison covers movements
of humans (persons) within different video films, humans in video films with avatars in
animated films and avatars in different animated films.
Image processing /rendering
Integral solution for optimization of the image processing and the rendering procedure has to
be developed. The data which has to be handled results from the program Maya.
Transition Algorithms
Developing transition algorithms for the optimization of the avatar movements.
Automatic character design
The solution covers two parts:
- Part 1: Solution enabling the automatic identification of the appearance of a person (human)
in a video or a photo. Based on the identified criteria an avatar will be created automatically
(look-alike).
- Part 2: Based on specifications e.g. professor, caring grandmother or naughty child the
systems automatically proposes the look of an avatar.
Improvement of the Learning Systems
Improvement of a database solution to generate translation proposals based on already done
translations in the past. The quality of the translations increases with each single case.
Improvement of prosody of the translation
This topic covers two parts:
- Part 1: Analyse the systematics of the prosody in different sign languages e.g. ASL or DGS.
- Part 2: Integration of the identified prosody systematics into algorithm for the automatic
integration into the avatar movements.
Détails de l’appel à manifestation d’intérêt
http://bit.ly/17t2krz