![Page 1: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/1.jpg)
www.asc-inclusion.eu
A project to develop software to assist people with autism to recognise, understand and
express emotions through facial expressions, voice and body gestures
![Page 2: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/2.jpg)
Autism & EmotionsAutism & Emotions• Difficulties recognizing and understanding mental states:
– Their own– In other people
• Aspects of difficulty include: – Facial expressions– Vocal intonation – Body gestures and body language – The integration of the above in context
• Difficulties in expressing emotions non-verbally, in all the above aspects.
• Emotion recognition and expression are not learned spontaneously >>> need to be taught explicitly.
Risk of social exclusion for individuals with autism is significantly increased without these skills.
www.ascinclusion.eu
![Page 3: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/3.jpg)
Project IntroductionProject Introduction
• A project to develop interactive games to assist people with autism to recognise, understand and express emotions through facial expressions, voice and body gestures
• Primarily for children aged 5 to 10, high functioning
•Can serve teenagers and young adults (with proper accommodations)
•Can serve more populations that are socially challenged, such as: ADHD, Hearing impaired
![Page 4: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/4.jpg)
Project Project PartnersPartners
www.ascinclusion.eu
Prof. Simon Baron-Cohen, head of the Autism Research Centre at Cambridge University, UK
Prof. Sven Bölte, Karolinska Institutet, Sweden
Dr. Ofer Golan, Bar-Ilan University, Israel
Prof. Peter Robinson, head of Cambridge Computer Lab, UK
Prof. Björn Schuller, Technische Universität München, Germany
Prof. Antonio Camurri, University of Genova, Italy
Autism-Europe (AE) Executive comitee
![Page 5: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/5.jpg)
Project Method & Project Method & RationaleRationaleThe ASC-Inclusion software will:•Analyse the children’s facial expressions, vocal intonations and gestures (standard microphones and webcams);•Train children to recognise and express emotions through Interactive lessons, fun games, animations, video clips;•Personalise settings according to children’s individual needs;•Support therapists and parents with professional information, reports on children’s progress and forums to interact with other carers.
www.ascinclusion.eu
![Page 6: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/6.jpg)
How the software will How the software will workworkInnovation meets interventionInnovation meets interventionThe program will consist of 3 state-of-the-art subsystems for: •Facial expressions•Vocal intonation•Body gestures
The subsystems will be integrated together in an online virtual world platform to provide the user with a comprehensive and motivating learning experience.
www.ascinclusion.eu
![Page 7: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/7.jpg)
How the software will How the software will workworkFacial expressions
www.ascinclusion.eu
![Page 8: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/8.jpg)
How the software will How the software will workworkVocal intonation
www.ascinclusion.eu
![Page 9: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/9.jpg)
How the software will How the software will workworkBody gestures
www.ascinclusion.eu
![Page 10: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/10.jpg)
Environment – Environment – Narrative Narrative
Environment narrative:
Complete fun learning
tasks to earn more fun
stuff!
The players are
researchers in an
international
research camp
located in the
jungle.
They research
human behaviour
and emotional
expression.
![Page 11: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/11.jpg)
Avatar: Create your Avatar: Create your charactercharacter
Click on different shapes of mouth, eyes, eyebrows etc. to express your mood
![Page 12: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/12.jpg)
Main area: The research Main area: The research CenterCenter
Get a task, see your research status, meet the mentor, use research tools
![Page 13: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/13.jpg)
Motivational Elements: Motivational Elements: HomeHome
Take a canoe to your home or visit a friend’s home, design your home
![Page 14: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/14.jpg)
Motivational Elements: Motivational Elements: GoodiesGoodies
Use the virtual coins you earned by completing “research missions” (=learning tasks) to purchase items for your home,
avatar and collections
![Page 15: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/15.jpg)
Motivational ElementsMotivational Elements:: GamesGames
Play cool games using your virtual money, meet friends
![Page 16: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/16.jpg)
Games: Facial expressionGames: Facial expression
Mahjong: Attention to detailsInitial level: Match happy faces.
Advanced level: Match different people who feel the same.
![Page 17: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/17.jpg)
Games: Emotional tone Games: Emotional tone of voiceof voice
Recognise what the speakers feel according to their voice
![Page 18: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/18.jpg)
Games: Body language Games: Body language hintshints
Edit your own movie using the hints you’ve learned
![Page 19: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/19.jpg)
Games: Cross-modal Games: Cross-modal trainingtraining
Match picture to sound: Listen to Timmy. Click on the picture of the character who feels like Timmy.
![Page 20: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/20.jpg)
Interactive books: Social Interactive books: Social scenesscenes
Enjoy funny stories on everyday social situationsCreate your own ending, Invent more comics stories with the characters
![Page 21: Www.asc-inclusion.eu A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions,](https://reader035.vdocument.in/reader035/viewer/2022062802/56649e8f5503460f94b930dc/html5/thumbnails/21.jpg)
Testing GameTesting Game
A highly rewarding learning:Answer the questions and win a million coins!