Currently more and more enterprises recognize the importance of data, and the construction of data warehouses and big data platforms is mushrooming. But data is a double-edged sword, it can bring business value to the enterprise at the same time is also the organization's biggest source of risk. Poor data quality often means poor business decisions, which will directly lead to inaccurate statistical analysis of data, difficult to supervise the business, and difficult decision-making by senior leaders. Therefore, many organizations urgently need a data quality inspection tool to improve data quality, then, a data quality inspection tool should have what features can be called a good tool? Maximum and minimum values of the values in the field

Number, frequency and percentage of data patterns of the values in the field

Number, frequency and percentage of the values in the field in different data placeholder formats

Standard deviation of the values when the values are numeric

Percentile when the values are numeric Percentile when the values are numeric Analyze

Automatic summing, calculation of the mean value when the values are numeric

Automatic summing, calculation of the mean value when the values are numeric

Number and percentage of the values when the values are numeric

Number and percentage of the values when the values are null

Second, it needs to be able to analyze the relationship between the data see:

1) Primary key analysis

The data quality inspection tool automatically performs primary key analysis when the data is imported, and discovers that all the primary key fields that meet or are close to meeting the uniqueness of the primary key, to help data administrators and business people can further determine the determination of the primary key.

2) Inter-field Dependency Analysis

The Data Quality Probe tool automatically performs inter-field dependency analysis in the table during data import to analyze the conflict of values between fields. This helps data administrators and business people to further determine whether inter-field dependencies are normal, and the analysis results can be drilled down to specific detailed records.

3) Inter-table relationship analysis

The data quality management platform can find the possible correlation between the table, analyze the number of values and the number of records that are the same/not the same between the two tables, and display the results intuitively and conveniently through the Venn diagram, and generate E-R (Entity-Relationship Model)

Third, the data quality probing tool needs to support multiple collaborators:

Data quality probing tool provides Notes, which is a tool that can be used to analyze the data quality of the data. Quality probing tools to provide Notes (Notes), Bookmarks (electronic bookmarks) and time logs (Event Logs) for data analysis tracking, recording. Convenient to view the outstanding problems found , places of concern and checkpoints , etc. , to facilitate the team to communicate and solve the problem .

Bookmarks: When analyzing data, you can create bookmarks, and will *** enjoy to others who need to view the subsequent click.

Notes: Categorize the issues you find and assess the business impactCategorize the issues you find and assess the business impact.

Permission control: you can set up different personnel, such as financial personnel can see the data, other less than financial personnel can see the data

Back and drill down: data quality probing tool provides its own back and drill down function, easy to carry out the results of profiling and diagnostic results of tracking, for example, through the value of a certain field of the data pattern, you can easily and accurately drill down to the matching detailed records

The back button can be used to display the previous data pattern, and the back button can be used to display the previous data pattern.

Fourth, business rules management:

1) Data quality probing tools with business rules management functions, data compliance checks, standards checks and other data diagnostic work, you can create, modify, delete, run, and quickly find business rules, you can quickly locate the business rules affected by the entity table, which helps to analyze the impact of changes in business rules.

2) Data quality probe tool has a business rule base management mode, which can categorize and prioritize business rules, support multiple formats for import and export, and support business rule reuse.

3) Data quality probing tool with business rules to provide flexible configuration of the pass rate threshold, to facilitate the flexible configuration of the enterprise's own data quality diagnostic standards, to quickly adapt to the changing business needs of the enterprise.

4)

The data quality probe tool has the ability to repeat multiple runs of the business rules, view and analyze the results of the business rules, and drill down to detailed information from the number of records that comply/do not comply with the business rules, to analyze and locate specific data issues. Results metadata and other profiling metadata stored in the data quality management platform library, very convenient to import to Excel or reporting tools for further graphical visualization and analysis.

Fifth, provide visual reports

Data quality probing tools provide visual reports, so that the data will be eh over at a glance.

Of course, if you can provide scheduling configurations, you can schedule and monitor jobs on time-series data, and do the early warning of abnormal data is perfect.