When you swung the caliper out of the way, did the pads remain in place in the caliper bracket? If so, they're probably wedged in tight at top & bottom where they slide in the caliper bracket. Keep prying & hammering.

When you put in the new ones, make sure they don't wedge in too tight. If needed, file the ends of the pad backing plates so they fit nicely.