Does it only do it when the wether is warm (the inside of the car is warm)? If so, the main PGM-FI fuel relay is famous for causing that problem. When the interior of the car gets hot the solder connections in the relay won't make contact, but when the interior cools down the joints will make contact again and allow the car to start.