If the starter doesnt "Click" sometimes you could have a problem with either the ignition switch or the starter relay or starter solenoid. If the brushes in the starter were the only problem then you would at least hear the solenoid in the starter go "Click". Could also be an intermittent bad connection somewhere.