Why do people say, "it's not what it looks like!" when it usually is?
People often say this to try and excuse their behavior. This is especially so if what is being talked about is something negative. Saying this often makes people feel less guilty.
They might be trying to save face, and the other person's feelings (like THAT helps).