Is there a difference between a header and an exhaust manifold? I thought they were the same thing?

Anyhoo you can take it off. It won't raise the engine bay temp any more than headers would. The shield is to protect you from burning your hands on the headers when working on your car. I had mine off for quite awhile before I found my headers. The exhaust manifold/stock headers will be rusty.