Big data generally needs to go through five main links from data source analysis and mining to final value, including data collection,

Data storage and management, calculation and processing, data analysis and knowledge display. The main technology used in the data acquisition stage is the data extraction tool ETL. In data storage, there are mainly structured data, unstructured data and semi-structured data storage and access.