http://www.hondaautomotiveparts.com/...S840_B3501.gif

I think that it'd be the shift lock solenoid (#2); seems to me like it's just not registering you're in park.

Put your car in drive before attempting to start it, I bet you notice the same symptoms.