We love virtual instruments but to create a new music apparatus with the Kinect is another, entirely great story. The Kinect Crossole Listening Machine is a custom program that enables user’s to plot and create their own music through gestures. This video by Youtube User sangwonlee717 displays their unique creation and how the Kinect serves as the primary receiver to plot and play the tunes. In the video, the user is seen creating music by plotting the points in the score using his gestures. The program then continuously plays the specific score, thus showing the changes every time the user customizes it. The program though has different ways of creating music but only one method to do so, which is gestured based. This is the next generation of music!
Here is a description by the developers:
“Crossole is a meta-instrument that allows you to control music in high level. The word “Crossole” is a portmanteau of “crossword” and “so-lee(소리)” which, in Korean, means sound. Literally, crossole is a crossword of sound. Chord progression of music is visually presented as a set of virtual blocks that will eventually start to resemble a crossword puzzle. With the aid of the Kinect sensing technology, you can either build music in high level by gestures of building a score(blocks) as well as you can play note by note by stepping into the low level(grid).
In the way that a crossole player build musical structure using a set of blocks and play music by moving a cursor within the blocks, you have to think about the musical structure prior to notes, melody or sounds. Variation in progression of music can be easily made by selecting a different route. Also, crossole let you record your route. Once you finish the recording, you can let crossole play music by traversing the recorded route in the background. In the meantime, the player can map his hand gestures to other interesting sound.”
For more information about the Kinect Crossole Listening Machine, visit the project’s Youtube Page.
Really nice video, great work! 🙂