From pixels to pitches: unveiling the world of color for the blind

We propose a tool, SonarX, which converts colorinformation from still images or video frames into sound. Thetool converts the hue, saturation and value parameters intosound parameters that influence the perception of pitch, timbreand loudness. The goal of SonarX is to help visually impairedindividuals to perceive characteristics of the environment thatare usually not easily acquired without vision. The tool has beenexperimented by visually impaired individuals, who confirmedthat it can be used to give them information about the rangeof colors present in the images, presence or absence of lightsources as well the location and shape of the objects.