It might be your tires as well.
Friend of mine had a similar problem, with new rotors and pads. His front tires had a different wear on each side due to bad alignment, causing it to vibrate quite a bit over time, as he hit the brakes. However that usually also pulls the car to the side when you brake.