Your fluid movements control the music produced by this synthesizer! The Kinect with SuperCollider maps movements and properly syncs them to control music, tunes and tempo. This video by stefan displays gesture-based synthesizer at work and how dancers can greatly benefit from this program. In the video a dance is seen moving gently and slowly. The Kinect uses skeletal tracking to properly recognize the intricate gestures of the dancer. The computer (Mac) then plays the or activates the corresponding tune or features that is mapped for the movement. So as the dancer moves, the synthesizer operates, beautifully highlighting the choreography and audio charm to the movement. Think, not only would a dancer move to the music but the music itself would adapt based on the intensity of the dancer’s movements!
For more information about the Kinect with SuperCollider, visit the project’s Vimeo Page.