I presume you paid with a Credit Card?
Often times CC companies have provide some sort of service where you can dispute a charge against your bill. Since you didn't get what you ordered, you might try contacting your CC company and see if there is anything they can do to help you out.

And that is total bullshit. You shouldn't have to pay a cent on that. It's not like a restocking fee, where you decided you didn't want it. They messed up. Any decent company should pay for their own mistake. At the very least, send in a complaint to the Better Business Bureau.