Current location - Loan Platform Complete Network - Big data management - North green bird design training: learning big data must learn programming?
North green bird design training: learning big data must learn programming?

At the mention of programming, many friends will feel a headache, complex and esoteric variety of code, so that people in front of the eyes to confusion.

Many friends who want to learn big data are wondering, can I learn big data without learning programming? I received a lot of similar questions, this article is detailed to talk about, learn big data can not learn programming, Java development using software /, to answer the questions in your mind it!1: First of all, to be sure to tell you, learn big data is a must learn programming Oh! Learn big data to involve some programming knowledge, but programming is not the focus, the focus is on the database.

In principle, big data development requires the foundation of programming languages, because the development of big data is based on some commonly used high-level languages, such as java and .Net.

If you want to engage in the development of big data, you still need to be proficient in at least one high-level language, which is definitely involved in programming knowledge.

2: learning big data can not learn programming, this question we already know the answer, we now come to talk about, big data to learn what.

To become a qualified big data engineer, you need to be familiar with the hadoop ecosystem, familiar with yarn, hdfs, hbase, hive and other various components of the deployment, build configuration and optimization; familiar with linux system, skilled use of shell or python for common script development and testing.

3: In addition, big data engineers also need to be familiar with big data analysis, skilled use of spark, mapreduce analysis and algorithm optimization, familiar with Java, Scala in at least one language; familiar with big data collection and storage, skilled use of flume, kafka, sparkstreaming, storm for data collection cleaning storage; familiar with big data full-text search, skilled in the use of elasticsearch, sorl, lucene, at least one search engine framework and so on.