In collaboration with Darkmatters and Hvass&Hannibal, YOKE.dk is working on interactive visuals for Trailerpark Festival 2011. This is a preview of our test setup. We use a kinect to let the audience control aspects of the visuals - for instance the lighting of the scene. The set is modelled in 3D and mapped accurately onto the physical model following a calibration process.
We use Openframeworks and OpenNI for the kinect tracking, Unity3D for the interactive 3D, and VDMX and Syphon for mixing Unity with pre-rendered content.