I had the same problem with my 01 Accord. It turned out to be the sway bar bushings. What happens over time, the sway bar bushings dry out and get hard and need to be greased up. What I did was take the sway bar bushings out, and coat them with a real heavy grease. Since I did this I haven't had any problems with the car. You could also go to the Honda dealer any buy new sway bar bushings.
Jay