I got some looks when I was moving, and had to carry my rifle to my car from my old apt. Maybe it was my appearance, I dunno, but you'd think around here people wouldn't think anything of a rifle... yet people do take notice. As would I in that situation, probably... pretty much unless you are wearing hunting gear (and have the appropriate type of weapon/tool) people are going to react with concern to seeing someone carrying a gun unless it's a cop, etc.
In my experience.

edit: doesn't me they/we are judging of course, it's just natural unless you know the person or are constantly exposed to it.