The characteristics of big data include a large amount of data, many kinds of data, strong real-time requirements and great value contained in data. Refers to the collection of data that traditional software tools can't capture, manage and process in an affordable time range. There are more and more unstructured data from different data sources, which need to be cleaned, sorted and filtered to become structured data.