Okay, the battery works fine. All the interior stuff works.
The starter works. The engine would roll over, just not start.
The whole situation was remedied by adding a little bit more fuel and trying again.
I have run it a few times since then now.
Apparently the little metal flap is broken off inside and is sitting in my tank now and was blocking the fuel from leaving the tank.