I believe ofRotate() calls glRotatef(), so this might be defined inside openGL.
If the rotation axis is of length 0, I would say the result is undefined (what did the user mean?). It’s something that should not happen.
My feeling is that if you expect this to happen, you should check for this condition in your code before calling ofRotate(). Checking if this happens inside OF for every call to rotate would make it slower, and not every user needs that check. It is common, and sometimes required, to use normalized vectors (length=1.0) for such operations.