Meta-media artist and air sculptor Hoonida Kim creates sound using the data of performers’ movements played by a new form of instrument called the “Unknown DataScape sense”.
Eight megaphones with sensors are positioned around the head of the performer to collect data in the changes of the surrounding. The distance between objects and the performer is measured using hacked lidar sensors, which are also found in autonomous vehicles and robot vacuum cleaners. The collected data are sent out in real time and played as soundscape audio, resembling tidal waves. Using 3D modeling, the sound data is recorded as a musical sheet and displayed alongside.