One other possibility is that it could be due to a problem with your suspension - worn/cracked bushings, bent control arm, etc.