Big data, also known as megadata, refers to a collection of data whose contents cannot be captured, managed, and processed within a certain period of time using conventional software tools. It arises from the huge scale of data resources brought about by the development of the Internet.
Internet big data refers to the collection of a large amount of information within a period of time through a variety of channels, including users' hobbies, purchasing tendencies, travel patterns, eating habits, consumption patterns, social software use, etc., and then these data are organized into useful data, and these data resources with the previous data, with obvious new features, as follows.
Characteristics:
1, Volume (large amount): With the passage of time, the storage unit from the past GB to TB, and even now PB, EB level. With the rapid development of information technology, data began to grow explosively.
2, Variety (Variety): Now the type of data is not only in the form of text, but more pictures, video, audio, geographic location information and other types of data, personalized data accounted for the absolute majority.
3, Velocity (high-speed): big data is generated rapidly, mainly through the Internet to transmit. Everyone in life is inseparable from the Internet, which means that every day individuals are providing a large amount of information to big data every day. Big data has very strict requirements for processing speed, a large number of resources in the server are used to process and calculate data, many platforms need to do real-time analysis. Data is being generated all the time, and whoever is faster has the advantage.
4, Value (value): the real world generated data, valuable data accounted for a small proportion of low value density. Compared to traditional small data, the biggest value of big data is through a large number of irrelevant data of various types, mining the future trends and patterns of predictive analysis of valuable data, and through machine learning methods, artificial intelligence methods, or data mining methods of in-depth analysis, to discover new laws and new knowledge, and used in agriculture, finance, health care and other fields, so as to ultimately achieve the improvement of social governance, improve production efficiency, and promote the effect of scientific research.