Rotors could be warped or uneven brake wear (calipers) if the car just shakes when your brake. Since it does it other times too then it could be a cv boot, or a whole axle.