3D facial video retrieval and management for decision support in speech and language therapy

Ricardo Carrapiço, Isabel Guimarães, Margarida Grilo, Sofia Cavaco, João Magalhães

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

3D video is introducing great changes in many health related areas. The realism of such information provides health professionals with strong evidence analysis tools to facilitate clinical decision processes. Speech and language therapy aims to help subjects in correcting several disorders. The assessment of the patient by the speech and language therapist (SLT), requires several visual and audio analysis procedures that can interfere with the patient's production of speech. In this context, the main contribution of this paper is a 3D video system to improve health information management processes in speech and language therapy. The 3D video retrieval and management system supports multimodal health records and provides the SLTs with tools to support their work in many ways: (i) it allows SLTs to easily maintain a database of patients' orofacial and speech exercises; (ii) supports three-dimensional orofacial measurement and analysis in a non-intrusive way; and (iii) search patient speech-exercises by similar facial characteristics, using facial image analysis techniques. The second contribution is a dataset with 3D videos of patients performing orofacial speech exercises. The whole system was evaluated successfully in a user study involving 22 SLTs. The user study illustrated the importance of the retrieval by similar orofacial speech exercise.

Original languageEnglish
Title of host publicationICMR 2017 - Proceedings of the 2017 ACM International Conference on Multimedia Retrieval
PublisherAssociation for Computing Machinery, Inc
Pages50-57
Number of pages8
ISBN (Electronic)978-1-4503-4701-3
DOIs
Publication statusPublished - 6 Jun 2017
Event17th ACM International Conference on Multimedia Retrieval, ICMR 2017 - Bucharest
Duration: 6 Jun 20179 Jun 2017

Conference

Conference17th ACM International Conference on Multimedia Retrieval, ICMR 2017
CityBucharest
Period6/06/179/06/17

Keywords

  • 3D video retrieval
  • Decision tool
  • Facial anthropometry
  • Speech and language therapy

Fingerprint Dive into the research topics of '3D facial video retrieval and management for decision support in speech and language therapy'. Together they form a unique fingerprint.

Cite this