Interactive performance using ofx + infrared cameras (with video excerpt)

We were commissioned to design the Annual Public Book Awards ceremony and we came up with a fictional journey which included the performance piece Orthographies, a set of dance phrases, underlined by live jazz music, where the performer was immersed in a fictional, interactive “Land of the Book”. Our challenge was to do everything using characters normally found in books, such as letters, numbers, punctuation marks and simple shapes (the client was in Greece, so Greek alphabet of course :slight_smile: )
Here is a four minute Vimeo excerpt from the show:

We used infrared cameras and our in-house tracking engine based on openCV to track all the action on stage and we developed (or extended) algorithms for autonomous agents, particle systems, fractals and we used the box2d physics engine and much more, in order to simulate natural forces and biological behaviours in a fictional world.

We’d like to thank the good people of the openFrameworks community who were kind enough to answer our many questions over the past months, especially @arturo, @jvcleave, @zach. Also thanks to @shiffman for writing that inspirational book “the nature of code”.

marinero (on behalf of the visualcortex team)


Hi, @marinero

awesome, I loved it
I’m a PhD student of theatre, researching about the use of new media
could you please, describe to me about lightning, projectors and the screen
material that you area using.
I saw others videos on site, congratulations, nice works.


Hi @phdcosta,
I am curious about your work. Tell me more, perhaps a link?

The projector is a standard projector (BARCO 8000). The screen is a grey gauze which is a standard theatrical semitransparent surface.

Hope this helps :).

thanks @marinero for your answer.

here you can find some of my experiments (simple things cause I don’t have many resources)

I’m a teacher in Brasil, studying in England until apr/2015. My PhD is more about impacts of technology over theatre. I’m autodidata programmer

my big problem now is the range of kinect to track the theatrical space - which camera to use? how to illuminate the stage? how to get only IR light on camera?

In summary, how to get a good tracking image?

thanks again