You can apply to the tax authorities for invoicing without tax registration. According to the relevant regulations, units and individuals can apply to the competent tax authorities for issuing business income invoices from the date of obtaining the business license to the date of obtaining the tax registration certificate when handling tax registration.
Without tax registration, you can't receive the invoice, because you have to have the company name and tax number.