ashzero- the reason why yours isnt too loud is cause you have a turbo. Most cars that i see/hear with turbo arent loud. It also depends on what you have done (exhaust wise)

If you keep your resonator (one after cat) its not going to be loud. I started out with a HKS cat-back and it wasnt any louder than stock. it was deeper though. I ditched the muffler the 1st month i had the exhaust and that gave it some rage. Got rid of the 1st resonator and it sounded nice. Not loud but nice and deep and sounded like air when boosting. still not loud enough for me.
Got the turbo upgraded, which added a 2.5in downpipe and testpipe (took out cat) my sh!t is loud as hell now. Its a little buzzy when slowing down but i think thats cause my muffler (Tsudo) but it sounds great at highway speeds and when boosting it sounds like a whole other car

To keep it quiet keep the cat although a highflow wont make it that much louder. Keep the resonator and i might suggest Magnaflow mufflers. For some reason i have never thought there mufflers were loud. OBX mufflers are also a good.

BTW- i have never heard a V6 Accord that was loud. I see this one all the time and hes got 2.5in straight pipe from cat-back with cheap mufflers and its not too loud. I thought it sounded great but not horrible loud