Color sonification for the visually impaired

Sofia Carmen Faria Maia Cavaco; Nuno Manuel Robalo Correia

doi:10.1016/j.protcy.2013.12.117

Color sonification for the visually impaired

Sofia Carmen Faria Maia Cavaco, Nuno Manuel Robalo Correia

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

We present a software tool developed to help the visually impaired to perceive characteristics of the environment related to color and luminosity. The tool converts color information extracted from images into sound, where the images can be still images, or video frames from live or stored video. The color information is extracted from the hue, saturation and value attributes, which are mapped into audio attributes directly related to the perception of pitch, timbre and loudness. The tool can be used to gather information about the range of colors present in the images, presence or absence of light sources as well the location and shape of the objects in the images. It is useful for blind people, but it has also applications in other areas such as chemistry and arts.

Original language	Unknown
Title of host publication	Procedia Technology
Pages	1048-1057
DOIs	https://doi.org/10.1016/j.protcy.2013.12.117
Publication status	Published - 1 Jan 2013
Event	HCIST 2013: International Conference on Health and Social Care Information Systems and Technologies - Duration: 1 Jan 2013 → …

Conference

Conference	HCIST 2013: International Conference on Health and Social Care Information Systems and Technologies
Period	1/01/13 → …

Access to Document

10.1016/j.protcy.2013.12.117

Cite this

@inproceedings{781ccd10069a44728a77a26907f4b589,

title = "Color sonification for the visually impaired",

abstract = "We present a software tool developed to help the visually impaired to perceive characteristics of the environment related to color and luminosity. The tool converts color information extracted from images into sound, where the images can be still images, or video frames from live or stored video. The color information is extracted from the hue, saturation and value attributes, which are mapped into audio attributes directly related to the perception of pitch, timbre and loudness. The tool can be used to gather information about the range of colors present in the images, presence or absence of light sources as well the location and shape of the objects in the images. It is useful for blind people, but it has also applications in other areas such as chemistry and arts.",

keywords = "sensory aids, image representation, image color analysis, Audio visual system, image sonification",

author = "Cavaco, {Sofia Carmen Faria Maia} and Correia, {Nuno Manuel Robalo}",

note = "Sem PDF conforme Despacho; HCIST 2013: International Conference on Health and Social Care Information Systems and Technologies ; Conference date: 01-01-2013",

year = "2013",

month = jan,

day = "1",

doi = "10.1016/j.protcy.2013.12.117",

language = "Unknown",

pages = "1048--1057",

booktitle = "Procedia Technology",

}

TY - GEN

T1 - Color sonification for the visually impaired

AU - Cavaco, Sofia Carmen Faria Maia

AU - Correia, Nuno Manuel Robalo

N1 - Sem PDF conforme Despacho

PY - 2013/1/1

Y1 - 2013/1/1

N2 - We present a software tool developed to help the visually impaired to perceive characteristics of the environment related to color and luminosity. The tool converts color information extracted from images into sound, where the images can be still images, or video frames from live or stored video. The color information is extracted from the hue, saturation and value attributes, which are mapped into audio attributes directly related to the perception of pitch, timbre and loudness. The tool can be used to gather information about the range of colors present in the images, presence or absence of light sources as well the location and shape of the objects in the images. It is useful for blind people, but it has also applications in other areas such as chemistry and arts.

AB - We present a software tool developed to help the visually impaired to perceive characteristics of the environment related to color and luminosity. The tool converts color information extracted from images into sound, where the images can be still images, or video frames from live or stored video. The color information is extracted from the hue, saturation and value attributes, which are mapped into audio attributes directly related to the perception of pitch, timbre and loudness. The tool can be used to gather information about the range of colors present in the images, presence or absence of light sources as well the location and shape of the objects in the images. It is useful for blind people, but it has also applications in other areas such as chemistry and arts.

KW - sensory aids

KW - image representation

KW - image color analysis

KW - Audio visual system

KW - image sonification

U2 - 10.1016/j.protcy.2013.12.117

DO - 10.1016/j.protcy.2013.12.117

M3 - Conference contribution

SP - 1048

EP - 1057

BT - Procedia Technology

T2 - HCIST 2013: International Conference on Health and Social Care Information Systems and Technologies

Y2 - 1 January 2013

ER -