just make sure your forces aren't perpendicular to the shaft. Try to get the angle of the screwdriver completely parallel with the shaft so that any and all forces just put away from the shaft. It shouldn't cause any issues. I mean use your judgement though, if you are smacking WAY hard you could break something