In short, this is a civil debt, and there is no punishment and no judicial organ to enforce it. He scared you.
Even if they throw away this information, they will not easily sue because of the cost of litigation.