He said it is impossible to blacklist you, but he can often go to the company to check your credit information and leave a record of the inquiry, which will affect your loan. Record the whole process when you call him next time. Once he dares to do that, you can sue him.
If you want to borrow money, I can find you a regular bank and company.