What made you suspect that your fast idle is at fault. Yes if your Fast idle is open, whicich it does during cold start-ups it will let more air through the throttle. This will give you a high idle and your vacuum will drop. It' sounds like you have a little vacuum leak.