Hi, Sound!
Developing tool: OpenFrameworks( C++ ), Arduino ( C ), Physical Computing
Hi, Sound! is an interactive installation designed for people who have difficulty hearing to feel the ocean sound via visual and touch senses. Once a viewer puts his/her hands on the touchpad, this installation is activated. It visualizes and projects the pre-recorded ocean sound onto the installation table and transmits the amplified vibration back to the touchpad to be felt by the toucher. This installation designated to allow players perceiving the wondrous nature of the ocean sound through an immersive and multi-sense experience.
The installation developed to objectively interpret and present the pre-recorded material of the ocean sound while offering an artistic experience.
During the trip to Puerto Rico, I was deeply touched by the glamour of the ocean sound in there and it caused me to think how sad it is if people cannot hear and feel the beauty of the ocean sound. From that inspiration, I came out the idea of creating one installation to translate and simulate ocean sound to allow people who have difficulty of hearing feel it via other senses.
Inspiration
After researching, I realized that it's viable that people can perceive auditory information through other senses by generating synesthesia, empathy, and resonance.
Interactive Sensation Mechanism
Installation Diagram
Sketch of the Installation Structure
Transmission of the sound
Installation Diagram
Touch Sensation & Visualization
Vibration - This installation installs one sound transducer located directly under the touchpad to transfer the vibration generated by playing the ocean sound back to the toucher. The reason for applying the vibration mechanism in the project is that feeling vibrations of sounds is the only way for people with hearing loss to recognize auditory information.
Visualization - The dynamic visual effects are generated from the program interpreting the pre-recorded sound. This project visualizes the auditory source by analyzing its volume and frequency, because for simulating purpose, it is one of the most objective ways to represent the sound information into visuals.
Installation Building Process
Documentation of the Working Process
2016