You turn it clockwise back into the cylinder. You have to make sure that the groove of the piston fit into the little notch on the back of the pad.

Sounds like you did something wrong as mine have never done that and I just recently upgraded to what you are running (Brembo blanks and Axxis Ultimates).