What does your contract say? Was it conditional upon finance?
If the vendor is agreeing to cancel out of the goodness of his heart, I don't think you have a choice about the deposit. A deposit can only be refunded under certain circumstances, which should be spelled out in your contract.