5 lines of Python code to implement a simple web crawler

1, Python code, such as, we from

http://gitbook.cn/Crawl data in this site.

2, before running the code to download the installation of Chardet and requests installation package, you can download the two installation packages in my blog for free. Unzip and place in the directory where Python is installed, such as

3. Open the CMD Command window for installation, as

Figure 1 Installing Chardet

Figure 2 Installing requests

4. Open the CMD Command window again to check if the installation is complete.

5, this time you can run the previous written crawler code, the results if,,, this has achieved a simple web crawler

5 lines of Python code to implement a simple web crawler