It seems to have become a more serious problem. My ABS pump started to leak and it seems to have affected my normal braking.
I started to get the buzzing noise a lot when I turned on the car and when I broke, the brakes would make a grinding noise even at very low speeds.
Since I pulled the ABS fuses the breaks seem to be working fine again. Seems that I may need to replace the pump or ditch it all together.