EyeMusic Sensory Substitution Device Enables the Blind to 'See' Colors and Shapes (IMAGE)
Caption
Top: The EyeMusic's constructed audio file preserves both spatial information and image colors. The Sensory Substitution Device resizes the image to X=40 pixels (columns) by Y=24 pixels (rows) and runs a color clustering algorithm to get a 6-color image. Middle: The 2D image's X-axis is mapped to the time domain, i.e., pixels situation on the left side of the image with sound before the ones situation on its right side, illustrated here in waveform. Bottom: The Y-axis is mapped to the frequency domain, i.e., pixels situation on the upper side of the image will sound higher in frequency while those on its lower side will sound lower in frequency, illustrated here in spectrogram representation.
Credit
<EM>Restorative Neurology and Neuroscience</EM> (Abboud et al.)
Usage Restrictions
None
License
Licensed content