Mine was evident while the RPM's dropped but once I knew the sound I could hear it on acceleration as well. As for your noise have you tried listening while under the hood and revving it? It may help you hear where the sounds coming from.
BTW I find my motor to be VERY noisey when cold.