Big Data has received a lot of attention since its submission and there is no uniform definition of what Big Data is mainly about.
What is big data
Big data is a collection of data that cannot be captured, managed, and processed with usual software tools within an affordable time frame, requiring new processing models with greater decision-making, insight, and process optimization capabilities of large-capacity, high-growth rate, and diverse information assets .
Technically, Big Data and Cloud Computing are as closely related as the positive and negative sides of a coin. Big data necessarily can not be processed by a single computer, must be a distributed structure . It is characterized by distributed data mining of large amounts of data. However, it must rely on cloud computing for distributed processing, distributed databases and cloud storage and virtualization technologies.
Big data requires special techniques to efficiently process large amounts of data that are tolerant of elapsed time. Technologies applicable to Big Data include massively parallel processing (MPP) databases, data mining grids, distributed file systems, distributed databases, cloud computing platforms, the Internet and scalable storage systems.
Big data technology characteristics
Big data technology can be understood as the extraction of valuable data from a large number of data resources for analysis and processing, the main performance characteristics are as follows:
Large volume of data, multiple types, low value density, fast speed, high time efficiency
What are the big data technologies
Big data field has emerged in the field of a large number of new technologies that have become powerful weapons for the collection, storage, processing, and representation of big data. Important technologies for big data processing generally include big data collection, big data preprocessing, big data storage and management, big data analysis and mining, big data display and application (big data retrieval, big data visualization, big data application, big data security, etc.).
[Application of big data technology]
Application of big data technology
I. E-commerce industry
The e-commerce industry initially utilizes the big data to carry out the correct marketing, advance the production materials, logistics management, etc. according to the customer's consumption habits, which is conducive to the meticulous social mass production. Due to the concentration of e-commerce data, the amount of data is large enough and the variety of data, the future application of e-commerce data will have more imagination, including the prediction of fashion trends, consumption trends, regional consumption characteristics, customer consumption habits, the relevance of various consumption behaviors, hot spots of consumption, and important factors affecting the consumption and so on.
Two, the financial industry
Big data in the financial industry has a wide range of applications, mostly applied to trading, many stock trading is now carried out using big data algorithms, these algorithms are now increasingly taking into account the social media and website news to decide whether to buy or sell in the next few seconds.