You have to first remove all of the srcews from the door panel. Then begin pulling the door panel towards you slowly so the snaps on the inside of the panel come loose. Once you do that, you have to then finese the door handle through it slot of the door panel, but if you get too much resisatnce then there may be another hidden screw behind the door panel that is screwed into the door frame itself. Once all of this is done, lift the door panel above the slot of the door lock at an angle where the door panle slants upward from the mirror side towards the opening, and slide the panel away from the mirror at that angle out of the door panel's track. From there you can disconnect the wires that are mounted onto the door frame from you old speakers, unscrew the speaker mount from its frame and replace the speaker then.
I had to do the same thing when I replaced all of my speakers too.