Adjusting the caster does involve using shims, it's true.

Caster doesn't get "off" very often though, any accidents? Potholes?

It'd be more money, but if you are worried, take it to your local Honda dealer, they'll be able to do it.