320 grit by hand is too coarse....320 on a DA Sander is fine. Go to a Auto Paint Supply Store and ask for a red or possibly a gray Scotch Brite pad...wet sand with one of those and it'll be plenty sanded.