I just wanted to share a project I recently finished. It’s a musical instrument powered by two Kinects controlling Ableton Live. We also projected a 30 metre by 12 metre projection onto a vacant building in downtown Auckland for the grand finale performance. The project was a collaboration for V, an energy drink here in New Zealand. The project was documented in web episodes and the final performance was filmed for a TV commercial and music video.
I used openFrameworks to power the visuals and the “air keyboard” that you see him playing at times. Another system ran Processing and a second Kinect to collect skeleton position data and control Ableton Live.
I never could have done it with out the openFrameworks community… I used heaps of addons in the project, and gained tons of insight from all your posts. Thank you all so much!
Cheers guys. I’ve always enjoyed reading about how other people do what they do, so I’m glad you liked the posts. I’ve got a couple more in mind for some other openFrameworks projects i’ve done.
Here’s a screen shot of the openFrameworks gui running the visuals. Lots of dials and knobs still in there from the “tweak a variable… oh that looks nice” phase of the project.
The whole system is automated, so i don’t press any buttons once he starts performing. In the video you can see him reach forward and “swipe”… that’s how he changes instruments. The kick he does at the beginning starts the main song.
I played with lots of shaders early on, when trying to nail a look for the “Green Man”, but in the end we went for the triangulated version. There’s still one post-processing shader in the system that adjusts the Levels of the output, so that we could do colour grading on the night to counter any problems with the projection.
The “pixelate” button does this:
And the “Woah” button does this (basically it just doesn’t clear the display buffer):
The “glow” effect was caused by it being projected. We kept the visuals clean and sharp and let the projector do the glowing for us
Hey guys I’m the other half of the dev team that built the audio control system that works in conjunction with Jeffs visual system.
I have just finished our post about how the audio system and details the background work that was done in the few months before Jeff joined and our forces combined. Unfortunately I dont have that many shiny pictures as my system just makes noise :P.
Good Work!