natural marker AR made with gpu sift

well guys, two years before i wrote an AR-like application with SURF in this post
http://forum.openframeworks.cc/t/natural-marker-ar-made-with-surf/2313/0

these days, i made some improvement. the feature point is changed from SURF to gpu accelerated sift. it’s more robust than SURF. you can watch the video here
http://v.youku.com/v-show/id-XMjM1MjUyNTQ4.html

as the video shows, it’s still not a real AR yet. what’s need to do is, to augment the virtual 3D model onto the live video from the cam. but i’m not very familiar with opengl things. so if anybody is interested in this and also would like to improve this with me, i can send the code to you.

cheers

This is really cool, can you post a little info on how you’re implementing SIFT on the GPU? I was checking out these:

http://csce.uark.edu/~swarn/pubs/assets/PPAC09.pdf

and

http://www.springerlink.com/content/07q50r763184463k/

but I didn’t get a ton out of them. Any more info would be much appreciated,

[quote author=“joshuajnoble”]This is really cool, can you post a little info on how you’re implementing SIFT on the GPU? I was checking out these:

http://csce.uark.edu/~swarn/pubs/assets/PPAC09.pdf

and

http://www.springerlink.com/content/07q50r763184463k/

but I didn’t get a ton out of them. Any more info would be much appreciated,[/quote]

check this out: http://www.cs.unc.edu/~ccwu/siftgpu/
quite easy to use.
the only problem is, it needs to create an opengl context, but OF already has an opengl context, so don’t know how to embed this into OF

This is great. Would you mind to share some source codes?

It’s great!!! Could I get a copy from it. Thanks.

Creating a new OpenGL context in OF is fairly tricky.

Looking at your previous post it looks like you’re comfortable working with the internals of OpenCV, so you might want to look at the gpu::SURF_GPU (http://docs.opencv.org/modules/gpu/doc/feature-detection-and-description.html) as it doesn’t require a new context. It does require CUDA but there’s also a OpenCL version (http://docs.opencv.org/modules/ocl/doc/object-detection.html?highlight=ocl#ocl::SURF-OCL)