Is there oil on both sides of the intercooler? If it is just that side, it is coming in from the intake manifold. Either way, it is really bad.
And yes, manifolds are one of the hottest parts under the hood. It will get hot since it is flowing air that is several thousands of degrees.