01. big data engineers
02. data analysts
03. big data scientists
04. other (data mining is essentially considered to be machine learning, but related to the data, it can be interpreted as a direction of the big data)
I. Big Data Engineer skills requirements
Two, big data learning path
Three, learning resources recommended (books, blogs, websites)
One, big data engineer skills requirements are summarized as follows:
Must be skills 10:01.Java Advanced Programming (virtual machine, concurrency) 02.Linux basic operation 03. Hadoop (here refers to HDFS + MapReduce + Yarn ) 04.HBase (JavaAPI operation + Phoenix ) 05.Hive06.Kafka, 07.Storm08.Scala09.Python10.Spark (Core + sparksql + Spark streaming ) 6 advanced skills: 01. streaming ) advanced skills 6:11. machine learning algorithms and mahout library plus MLlib12. R language13. Lambda architecture14. Kappa architecture15. Kylin16. Bird learning is ok)
02.Java Advanced Learning ("Deep Understanding of the Java Virtual Machine", "Java High Concurrency Battle"
Second Stage:
03.Hadoop (Dong Xicheng's book) 04.HBase ("The definitive guide to HBase") 05.Hive ("Hive Developer's Guide") 06. Scala ("Learn Scala") 07.Spark ("Spark Fast Big Data Analysis") 08.Python (follow Liao Xuefeng's blog to learn on the ok)
Third stage: corresponding skills needs, to the Internet to collect more information on the ok, I put the most important thing (to learn what to tell you), the rest is that you go to collect corresponding to the information to learn on the ok. The information to learn on the ok of course, if you feel that the efficiency of their own books is too slow, you can collect some courses online, follow the course is ok. This is completely according to their own situation to decide, if the efficiency of reading books is not high on the Internet class, on the contrary, if you read the book.
Three, learning resources recommended:01.Apache official website 02.Stackoverflow04.github03.Cloudra official website 04.Databrick official website 05.Past Memories (technology blogs) 06.CSDN, 51CTO 07. As for the books when Dangdang, Jingdong a search will be a lot of, in fact, the contents are Almost
Then how to start from scratch to plan the road of big data learning!
The field of Big Data is so broad that it is often daunting for people who want to start learning Big Data and related technologies. There are numerous types of big data technologies, which again makes it difficult for beginners to choose where to start. This article will show the way and help you get started on your journey of learning big data and getting a job in the big data industry.