Have someone else turn off the car so you can stick your head under the hood & locate the sound more closely.

Just a dumb guess... vacuum leak at the brake booster? Or a busted check valve that's supposed to hold vacuum in the booster.