Clicking on ofxIntSlider (or others) causes click in background too

Sometimes, clicking and dragging on a slider (such as ofxIntSlider) in an ofxPanel (in ofxGui) causes the click to ALSO occur on the background - i.e. the main oF window.

How can I prevent this?