sounds like you have the infamous downpipe rattle gsr's are known for. basically, the downpipe is double walled and the weld's on the inner wall break allowing it to rattle against the outer.
you can try to find another downpipe or just replace the entire thing with an aftermarket header.