I don't think many people are at the point yet where they see the brows and don't expect the rest: the lashes, the mascara, the foundation, the lips.

But, of course, you might get accused of putting on "woman-face."

So far, I haven't run into this, even though brows are the "only" facial stuff I do anymore. But the clothes and behavior "complete" the picture for those not yet far enough along on their social re-construction, so I'm going to say that's why I don't get hassled.