The biovisualspeech corpus of words with sibilants for speech therapy games development

Sofia Cavaco, Isabel Guimarães, Mariana Ascensão, Alberto Abad, Ivo Anjos, Francisco Oliveira, Sofia Martins, Nuno Marques, Maxine Eskenazi, João Magalhães, Margarida Grilo

Research output: Contribution to journalConference articlepeer-review

1 Downloads (Pure)

Abstract

In order to develop computer tools for speech therapy that reliably classify speech productions, there is a need for speech production corpora that characterize the target population in terms of age, gender, and native language. Apart from including correct speech productions, in order to characterize the target population, the corpora should also include samples from people with speech sound disorders. In addition, the annotation of the data should include information on the correctness of the speech productions. Following these criteria, we collected a corpus that can be used to develop computer tools for speech and language therapy of Portuguese children with sigmatism. The proposed corpus contains European Portuguese children’s word productions in which the words have sibilant consonants. The corpus has productions from 356 children from 5 to 9 years of age. Some important characteristics of this corpus, that are relevant to speech and language therapy and computer science research, are that (1) the corpus includes data from children with speech sound disorders; and (2) the productions were annotated according to the criteria of speech and language pathologists, and have information about the speech production errors. These are relevant features for the development and assessment of speech processing tools for speech therapy of Portuguese children. In addition, as an illustration on how to use the corpus, we present three speech therapy games that use a convolutional neural network sibilants classifier trained with data from this corpus and a word recognition module trained on additional children data and calibrated and evaluated with the collected corpus.

Original languageEnglish
Article number470
Pages (from-to)1-18
Number of pages18
JournalInformation (Switzerland)
Volume11
Issue number10(SI)
DOIs
Publication statusPublished - 2 Oct 2020
Event14th International Conference on the Computational Processing of Portuguese, PROPOR 2020 - Évora, Portugal
Duration: 2 Mar 20204 Mar 2020

Keywords

  • Children’s speech corpus
  • Serious games for speech and language therapy
  • Sibilant consonants
  • Speech sound disorders

Fingerprint

Dive into the research topics of 'The biovisualspeech corpus of words with sibilants for speech therapy games development'. Together they form a unique fingerprint.

Cite this