Mainly client access layer, service provisioning layer, and basic computing layer,
The client layer mainly has cli tools, dt tools, external systems, and upper tier applications.
The service delivery layer mainly has: user management, privilege control, metadata, business processing, load balancing, access services, task scheduling, data delivery, access billing.
Basic computing layer: hdfs, hive, spark, hbase, yarn
Data *** enjoyment: users create *** enjoyment resource packages, through *** enjoyment resource packages to share data to multiple users.
The middle layer is a bridge between the application and the underlying components in the big data architecture. Without the middle layer, there will be a lack of abstraction and encapsulation of the underlying cluster service api, as well as the inability to close and protect the data.
Control access internally and provide a unified access mechanism externally, thus providing services to the outside world as a more complete system.