It will be fine.

I would definitely recommend a vacuum manifold for two reasons, though. Firstly, you get a better vacuum source since you are tapping into the brake booster vacuum line and secondly, it will look much cleaner and make diagnosing problems easier. For $30, it really is a good investment.