If the loan application stage has been submitted

You can terminate the loan as long as you make it clear that you don't want to borrow when you verify the loan information at the bank.

If it has been accepted and passed

You still need to sign a formal loan contract to take effect, as long as you don't sign it.