The latch itself. You just have to pull the black pin, and then slide the latch off. Is that right?
However, I'm not sure how to get the lever off. This is what I'm calling the lever:
The backside the lever is held in by the rod. The rod is U bent. Can you just slide it off???