It sounds to me that if pushing on the fuse box solves the problem, then you have something that is loose in there. I would just take a look inside that box and see if you can find something obvious. Other than that, I am all out of ideas.