Projected images no longer need to remain static as the Kinect now has the power to make them interactive and also behave like real objects do! The Kinect Projection Mapping with Box2d Physics is a program that allows users to interact with “almost real”virtual objects. This video by Michael Korostelev displays how a user’s interaction can stimulate a real-life behavior on some projected objects (this time, these are colored balls). In the video, as the user interacts with the projected colored balls, the balls react as if they were real, lifting up if the user lifts up his arm and falling down as the user retrieves his arm. This is a great example on how the various Kinect hacks can be improved with existing engines and software support. It is now a matter of time before we see a wave of revolutionary Kinect hacks!
Here is a description by the developer:
“Here’s a video of a kinect projection mapping setup. After calibrating the kinect depth and rgb images, and calibrating them with a projector using some clever automatic calibration techniques, we can track and overlay objects in the space. Using OpenCV, libfreenect and a physics engine, box2d, we can up with a fun toy demo where a user’s body is recognized as a rigid object in the physics engine that can interact with projected light.”
For more information about the Kinect Projection Mapping with Box2d Physics, visit the project’s Youtube Page.