Wasn't so sure you could rule out the other possibilities at first but I agree with IgOtNOluCk. Chances are if it's an on/off problem the main relay would be the culprit.

Anything else that might be on/off would most likely cause it to take a long time to start but it finally would.