Opencv stitch images

Im trying to stitch 2 images to later do some tracking stuff.

I tried to use the opencv stictcher class and it works, but even with the gpu flag it spends 2-3 secs to do the stitch and its too slow to use in realtime, so it seems like my approach its not correct.

What its the best way to do realtime stitch?