Cranks don't go out of balance? It's not a tire.

Balancing a crank also doesn't make a 4-cyl run smoother as that's what the harmonic shafts do. The pulley likely helps dampen vibration but it's not balancing anything out.

Try re-installing the old pulley, it's likely the old one had some damping to it. Else, learn to live with a rough engine as removing many OE recipricating parts cause this.