Optical Flow to box2D Forces

Hi there,
I am trying to improve an Installation. (this one: https://vimeo.com/120791544)
If you look closely you will notice that you can’t make rapid movements with this Engine. The Box2d Objects will fall into the bodies.

My naive solution to this Problem would be to use ofxCv and extract optical flow data, then pushing these into box2d forces which put pressure on the balls.

Can anyone give me advise on this problem? Any better solution? Has anyone done something like this?

This may help: box2d kinect object movement question