depends on what you mean by "hand car wash". Some of these places constantly use the same rags over and over, which contain dirt, which might do you more harm.
Also, some "hand car wash" places use high pressure hoses to wash the car. That's not a good idea either only because dirt + high pressure = sanding effect over time.