If you can start, then don't release the key to spring back to 'on'. Instead try to hold it in some intermediate position where it stays running but the starter quits spinning.

If you can do that, it's a bad ignition switch.