Current location - Loan Platform Complete Network - Big data management - How to Capture and Analyze Open Data on the Internet
How to Capture and Analyze Open Data on the Internet
Introduction: The Internet is rich in open data resources, through the acquisition of these data, as an auxiliary support for urban research, is one of the necessary skills of future urban researchers, we will continue to introduce some simple and interesting applications of open data analysis.

In the Internet, the capture of data is called "acquisition", and with the help of an acquisition tool, you can quickly capture the entire data of a website, and if this data can assist us in some of our decision-making, it is worthwhile to learn how to use this tool and method. (In this article, the data capture tool is "Trainwreck" software)

Zheng Xiaowei, from the Experimental Center for Urban Experience, Simulation and Analysis at Xi'an University of Architecture and Technology (XUAST), shared with us his experience in open data acquisition methods and applied analysis techniques.

Basic knowledge about open data (big data)

Difference between open data and big data

Open data: data from commercial websites (Dianping, Anjuke, etc.), data from open platforms of maps, data from social media (Sina Weibo), data from open government affairs, and so on.

Big data: cell phone signaling data, floating vehicle data (e.g., in-vehicle GPS, bus swipe card, subway swipe card), etc.

Big data is approximate full sample data, while open data is non-full sample data: