It is possible to remove headlights w/ the bumper still attached, but if you don't have the cross member on the car (that thing with the "retainer plates").

Since the cross member isn't there, the OEM bumper tends to sag a little, therefore you could pry out the headlights w/o the removal of the front bumper.