The ASC-inclusion perceptual serious gaming platform for autistic children

Erik Marchi, Björn Schuller, Alice Baird, Simon Baron-Cohen, Amandine Lassalle, Helen O'Reilly, Delia Pigat, Peter Robinson, Ian Davies, Tadas Baltrušaitis, Andra Adams, Marwa Mahmoud, Ofer Golan, Shimrit Fridenson-Hayo, Shahar Tal, Shai Newman, Noga Meir-Goren, Antonio Camurri, Stefano Piana, Sven BölteMetin Sezgin, Nese Alyuz, Agnieszka Rynkiewicz, Aurelie Baranger

Research output: Contribution to journalArticlepeer-review

15 Scopus citations


“Serious games” are becoming extremely relevant to individuals who have specific needs, such as children with an autism spectrum condition (ASC). Often, individuals with an ASC have difficulties in interpreting verbal and nonverbal communication cues during social interactions. The ASC-Inclusion EU-FP7 funded project aims to provide children who have an ASC with a platform to learn emotion expression and recognition, through play in the virtual world. In particular, the ASC-Inclusion platform focuses on the expression of emotion via facial, vocal, and bodily gestures. The platform combines multiple analysis tools, using onboard microphone and webcam capabilities. The platform utilizes these capabilities via training games, text-based communication, animations, video, and audio clips. This paper introduces current findings and evaluations of the ASC-Inclusion platform and provides detailed description for the different modalities.

Original languageEnglish
Article number2864640
Pages (from-to)328-339
Number of pages12
JournalIEEE Transactions on Games
Issue number4
StatePublished - Dec 2019

Bibliographical note

Funding Information:
Manuscript received January 2, 2017; revised October 7, 2017, March 10, 2018, and June 23, 2018; accepted July 16, 2018. Date of publication August 9, 2018; date of current version December 23, 2019. This work was supported by the European Community’s Seventh Framework Programme (FP7/2007–2013) and Horizon 2020 under Grant 289021 (ASC-Inclusion) and Grant 688835 (RIA DE-ENIGMA). (Corresponding author: Erik Marchi.) E. Marchi is with Siri Speech, Apple Inc., CA, USA. The work was done while at the Machine Intelligence and Signal Processing Group, MMK, Technische Universität München, Munich Germany, and also with audEERING GmbH, Gilching Germany (e-mail:,

Publisher Copyright:
© 2018 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See standards/publications/rights/index.html for more information.


  • AI in games
  • Autism spectrum condition (ASC)
  • Emotion recognition
  • Inclusion
  • Virtual computerized environment


Dive into the research topics of 'The ASC-inclusion perceptual serious gaming platform for autistic children'. Together they form a unique fingerprint.

Cite this