This is a common problem with band pass boxes.

They have do be exclusivley designed for the driver, and there is just about no room for error.

Don't plug the ports up. That will just cause worse sound.

Get a sealed box if you are craving better quality, that will be the quickest fix.