Loading...
Please wait, while we are loading the content...
Similar Documents
Design and Implementation of Craweper Based on Scrapy
| Content Provider | Scilit |
|---|---|
| Author | Ma, Xiaoju Yan, Min |
| Copyright Year | 2021 |
| Description | Journal: Journal of Physics: Conference Series With the development of the Internet, network data covers various fields, but with the increasing amount of network data and diversified data formats, it becomes more and more difficult for users to obtain valuable data from massive data. At present, data collection technology has been studied at home and abroad, and has found that network resources can be automatically obtained through network crawler technology. This article takes the information of second-hand housing in Chongqing as an example, designs a crawler program based on Scrapy framework, captures and stores the housing information in some central and western regions, and finally uses Excel data analysis to analyze the second-hand housing resources in Chongqing according to the region and house type. The results show that this program can automatically collect housing information from Anju customers, improve the speed and quality of user obtaining information, and provide a data source for user data analysis. |
| Related Links | https://iopscience.iop.org/article/10.1088/1742-6596/2033/1/012204/pdf |
| ISSN | 17426588 |
| e-ISSN | 17426596 |
| DOI | 10.1088/1742-6596/2033/1/012204 |
| Journal | Journal of Physics: Conference Series |
| Issue Number | 1 |
| Volume Number | 2033 |
| Language | English |
| Publisher | IOP Publishing |
| Publisher Date | 2021-09-01 |
| Access Restriction | Open |
| Subject Keyword | Journal: Journal of Physics: Conference Series Users To Obtain Housing Information Network Data Hand Housing Second Hand |
| Content Type | Text |
| Resource Type | Article |
| Subject | Physics and Astronomy |
