Platform level security
Traditional privilege control is usually designed with system functions in mind, and the purpose of privilege control is achieved by controlling user access to functions. This type of control has been stretched in the big data center, for example, for the same data analysis function, analysts of different products can only operate the data of this product;
Data level security
Big data centers are responsible for providing the ability to process data for all of the company's products
Risk Prevention and Audit
The business form of the product determines its system design, and during its continuous evolution, the data model is also evolving, which will certainly Some dirty data will continue to be generated, and to ensure the quality of the data, more manual involvement will be added to the data governance process, which also increases the risk of data leakage;
Processes and systems
Which data can be made public, and what is the scope of the disclosure? Who can the data be used by? What is the process for a business unit to use data from another business unit? For a long time, these things have been handled in a very flexible way, with no rules at all.
What are the common problems of building a big data platform, I share with you here. If you have a strong interest in big data engineering, I hope this article can help you. If you still want to learn more about data analysts, big data engineers tips and materials, you can click on other articles on this site to learn.