I used to interview individuals for positions and if someone (male or female) was dressed showing inappropriately it didn't come across well.
There are those that think other attributes can offset skills.
In this society, all men are intrinsically at risk if they put themselves in a position where they're alone with a woman. If that woman were to turn around and accuse them, it would be he said/she said and usually the man comes out on the wrong end of that. It's the same reason why teachers can't be alone with students. Now, most people are decent and would never accuse you, but you're still opening yourself up to that risk.
One out of ten sexual harassment charges are against men, statistically. Personally it's never happened to me although I've been alone with another woman very frequently in the workplace. Of course, I was never an asshole.