Aufio-based live video distortion

Hi everyone !

I’m a bit new to oF, messed a little bit with the webcam input, which resulted in this :

The coordinates of the brightest pixels of the image are used to draw some shapes. That’s cool, but it can get boring.

I want to do a program for some live music event, that would take a video input, most likely live camera, and distort/glitch it with some audio input. I’ve been looking around the net and the forums for way to do so, but i can’t find anything.

How could i do it, and where should i look at ?