I only balance my tires when I feel some sort of vibration at higher speeds.

The less they are balanced, the less wear and tear on the alloy wheels from the tape weights, clip-on weights, wheel balancing machine, tire techie, etc. Steelies might be okay for more frequent balancing jobs though.