Anyone can explain this tech.. how did they do this..

I saw this recently, I was wondering how did he separate the box to the body part from the ir camera. I’m thinking about some method that detecting the box then mask out the thing… but it seems like the algorithm is really accurate… even the arm’s overlap will be cut out…

this is the link:
https://www.youtube.com/watch?feature=player-embedded&v=zBm3mJiJzh8

btw, this is recent work by Daito Manabe… freaking awesome work…

Thanks for any ideas!

I’m not sure, but maybe they used some ir reflecting materials for the clothes, and paint for the cubes. If these have different reflective efficiency then one can separate the shapes by color in the ir camera image.

-Gabor