It's possible that it could still be the exaust too. As the temp goes down, things contract and get smaller. It may be that the exaust leak is now slightly bigger. At WOT, the manifold gets really hot really quick and it could be sealing up. Do you notice it more when the car is cold(just started) or is it the same all the time?

What kind of car is this? Year/make/model?