ofx3DModelLoader and quad warping

I’m trying to use ofx3DModelLoader to load a 3D model and create an augmented reality application which gonna draw this model. Since now, I’ve been able to display the model. Now, I’d like to adapt the display of the model according to the surface. I need to convert the view of the 3D model to an image (IplImage probably) so that I can transform it using quad warping.
Any idea?

for the augmented reality you’d rather move the camera than using quad warping to adjust to the surface.
for quadwarping I wrote simple addon that would make it.

as for moving the camera instead you can compute an homography based on tracking some points.
So far what immediately come to my mind is this: