If a finance company cancels an auto loan, can I get my down payment back?

I was sold a car, it turned out to be a lemon. Finance company has cancelled the loan, the place that sold me the car has the car back in their possession. It was basically undone. The seller is stating they do not have to give me back my $1000 deposit. Do I have any recourse?