Any buyer who terminates a binding Agreement of Purchase and Sale (APS) should expect the vendor to move for the forfeiture of their deposit immediately. In a depressed market, an innocent seller may even be entitled to further damages to make up the difference between the sale price agreed in the failed deal and any lower bid they ultimately accept.
However, purchasers who successfully shift the blame for the collapsed deal to the vendor may be able to recover their deposit, even if they were the ones to call it off.