Thank you for the replies everyone. By "pulley" I of course meant the bearing.

Idler pulley is a very good idea that didn't occur to me. It started making the same sound today after I would get off the throttle and on to the brakes, but go away after a blip of the throttle. Anyone have tips on replacing it?