I think you should disconnect the booster hose (The one with the check valve) from the booster. Start the engine and block the opening of the hose. If the idle change / become better it is the check valve leaking.

Now the question is where the leak in the booster is.

I just replaces this hose on my accord 1999. It was about $25.

do the test and see what's happend.