ofxARKit – How to capture face texture & model back onto face geometry

iOS
#1

Hi all,

Using ofxARKit, I want to take the texture of the user’s face and map it back onto the face geometry…
Here’s an example of what I’m trying to achieve…

Have any of y’all done something like this before? I’m a little lost as to where to start here, any advice/suggestions would be greatly appreciated!

Cheers,
Armon

#2

Hi @armonnaeini ,

yes in my opinion you should try to map the position of the vertices of the face to a uv index to sample the view image.
Sample using the gl_FragCoord to get the uv coords of each vertice of the face mesh, then store them into a buffer which gets re used when sampling the texture of the colors, using those coordinates.

Hope this helps,

Let me know,

Best,

P