Rotate the tire just to rule them out. It could be a bent rim or hub. If it only will do this when you brake it could be a rotor with a lot of run out.

Possibly a bad wheel bearing but you would have a noise too.