He is grabbing the bit.

Since a horse follows it's head many times while breaking a horse it is necessary to grab closer to the bit and pull the horses head down towards the ground (sometimes to the ground in fact) to teach it who is boss and how things really work.

Only a flatlander would think he is punching his horse especially since your horse was not only your means of transportation but also your livlihood.