razor blades, a bottle of rubbing alcohol, aand a bottle of booze. Use the last one to the point that the first one won't hurt you, then use the second to aid in the use of the first.

Now seriously, just rip it in as large of chunks as you can. On the back window, you may want to use a scotch brite pad with rubbing alcohol. Shouldn't damage the defroster.