Thanks for all the great advises.
I will bring it back to the dealer one more time and request to have to it change again. My dealer told that Accord 03-05 uses the same engine which 03 Accord's noise has been reported.
The bad thing about this noise is very loud while I am accerlating. I can hear the click sound over my cd volume level 6 so which is still kinda loud over all.