A serious mobile game with visual feedback for training sibilant consonants

Ivo Anjos, Margarida Grilo, Mariana Ascensão, Isabel Guimarães, João Magalhães, Sofia Cavaco

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

The distortion of sibilant sounds is a common type of speech sound disorder (SSD) in Portuguese speaking children. Speech and language pathologists (SLP) frequently use the isolated sibilants exercise to assess and treat this type of speech errors. While technological solutions like serious games can help SLPs to motivate the children on doing the exercises repeatedly, there is a lack of such games for this specific exercise. Another important aspect is that given the usual small number of therapy sessions per week, children are not improving at their maximum rate, which is only achieved by more intensive therapy. We propose a serious game for mobile platforms that allows children to practice their isolated sibilants exercises at home to correct sibilant distortions. This will allow children to practice their exercises more frequently, which can lead to faster improvements. The game, which uses an automatic speech recognition (ASR) system to classify the child sibilant productions, is controlled by the child’s voice in real time and gives immediate visual feedback to the child about her sibilant productions. In order to keep the computation on the mobile platform as simple as possible, the game has a client-server architecture, in which the external server runs the ASR system. We trained it using raw Mel frequency cepstral coefficients, and we achieved very good results with an accuracy test score of above 91% using support vector machines.

Original languageEnglish
Title of host publicationAdvances in Computer Entertainment Technology - 14th International Conference, ACE 2017, Proceedings
PublisherSpringer Verlag
Pages430-450
Number of pages21
Volume10714 LNCS
ISBN (Electronic)978-3-319-76270-8
ISBN (Print)978-3-319-76269-2
DOIs
Publication statusPublished - 1 Jan 2018
Event14th International Conference on Advances in Computer Entertainment Technology, ACE 2017 - London, United Kingdom
Duration: 14 Dec 201716 Dec 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10714 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Advances in Computer Entertainment Technology, ACE 2017
CountryUnited Kingdom
CityLondon
Period14/12/1716/12/17

Keywords

  • SPEECH RECOGNITION
  • FEATURE-EXTRACTION
  • THERAPY

Fingerprint Dive into the research topics of 'A serious mobile game with visual feedback for training sibilant consonants'. Together they form a unique fingerprint.

Cite this