Live motion data capture with a webcam or kinect?

I want to create a sort of “tool” that allows users to capture motion data through their phone or webcam, kind of like ARKit’s motion capture feature: https://www.youtube.com/watch?v=29uNziYYZZ0 but instead of overlaying the 3D model over the video capture, I want the motion data to feed directly into Unity or Blender if that makes sense. Ideally, I’d love to have the output look something like this Unity Plugin: https://github.com/keijiro/Skinner or something to that effect, like experimental effects that react to motion.

I’m not 100% if OF would be the best tool for creating something like this… Let me know if you have any suggestions!