odds are if you guys go to court you win.

if you have signed documents, even hand written, that state deposit is non-refundable then there is not much he can do. he can try but as you said you have a witness to the deal.

as for forcing him to buy, thats not going to happen...this isnt that legally binding of a contract.