Hello owner, this large system of hardware equipment, software technology requirements are very strict. Every year, 618, double 11, for Jingdong, Ali's technical gurus, very nervous state. The volume of orders processed per second for this kind of event is ten million. This kind of big system is all done by the various subsystems with each other.

There is no need to talk about the hardware equipment, procurement of the best. Focus on the software part. For this kind of big system. With a lot of technology. Is also the industry are using technology, such as big data real-time data processing, big data real-time computing, almost quasi-real-time query retrieval and so on.

The technology used for real-time data processing of big data is mainly Flume+Kafka+SparkStreaming, Flume+Kafka+Storm, Flink and so on. The technical details of each of these technologies will not be told in detail. They are all open source frameworks used to deal with large amounts of data, for Jingdong or Ali is likely to optimize the source code, developed to suit the needs of their company's scenario framework. But the core technology differences are not significant.

Big data real-time computing technology is basically using Kafka, SparkStreaming, SparkSQL, SparkGrapnX, etc. in one or more to complete.

Big Data quasi-real-time query retrieval with a lot of technology, here are two, one is an interactive query to create a secondary index (Hbase + Solr), the other ElasticSearch full-text search framework.

The technology used in the large system is similar, the key to see how the architects design and architecture of good business scenarios, the design is not good, there will be the earliest ticketing system 12306. well-designed like the current Jingdong Mall, Tmall Mall, to deal with the amount of data so large can still run normally.

Technology in the rapid development of various industries in the future there will be such a ten million second processing platform. We need to keep charging ourselves to learn. We're all in this together!

Thank you all! If you have any questions, you can write to me privately.