Change video with kinect

Hi, i’m using ofxKinect trying to do a character following my hand. I have 3 videos (walking and stopped). The question is… how can i change the video when the hand (blob) is doing a positive or negative move in the X axis.

Thx.

you can get the centroid from the blob and then check the depth at that point - maybe that would work?