i've had a similar problem on my 98 accord.

i took apart the starter selenoid and cleaned it and it hasn't happened since...it was just a contact problem.