Pull out all the polyfill. Use just enough the have a thin layer on the interior walls of the box.

Take the sound deadening off of the sub, what were you thinking?? I don't think it's hurting anything, but why would you do that.

It's the poly fill that killing the sound.