The noise is the shockwave that is produced when the throttle closes. The shockwave is rattling the turbo wheel against it's thrust bearings. That is why you need a blow off valve. If you don't get a blow off valve, expect to rebuild the turbo very soon.

My idle is around 750 rpms. It fluctuates a bit because I have an open atmosphere bov that leaks at idle.