A long time ago I heard of the Python crawler, but has not been to understand, think of one aspect of knowledge to learn before you learn about other emerging technologies.
But now the project has a need, to crawl some information online, and then do data analysis. So start learning the Python crawler from scratch, if you are interested in Python crawlers, then you can follow me to learn about it!
Gossip will not force, the following begins the path of Python crawler!
First of all, Python crawler, that must be written in Python language, then the first step must install the Python environment (after installing the Python environment, we can happily write code).
1. Understanding the Python environment
First of all, to get the computer to know the Python code you're writing, we need something called the compiler (called the Interpreter in Python), and after the Python compiler is installed, the Python code we write can run on the computer. Then you may ask: We write code before, as long as the installation of a software on the line, from the beginning of the C + + language to write VC + +, the latter may use the code Blocks, and then basically used in the back of Visual Studio (VS) or eclipse. In this case, we installed the software (VS, Eclipse) called the Integration Environment (IDE), is to help us write code, in the absence of the IDE, our great programmers are written in Notepad to write code, and then through the compiler to compile the operation Yes. Now with the IDE, we can use its powerful features to quickly and easily write code. So now we can divide the python environment into two things: 1, the compiler (which allows the code to run), and 2,ide (which helps us write code).
2, install the Python compiler
Note: Python2 and Python3 are very different, it is recommended to install Python3.
Reference website
a, go to the official website to download their own computer operating system corresponding to python.
b, download the installation program or the installation program .
Check First Add Python 3.5 to PATH(adding environment variable) and click Install.
When the installation is complete, enter python in cmd command-line mode if a prompt >>> indicates that the installation was successful. >>> says it has entered the Python interactive environment and can write Python code in it! Enter exit () to exit to the command-line mode. In command-line mode, you can run Python files directly using the Python file name. py.
3, installing the IDE
There are many kinds of Python ides, and individuals prefer JetBrains Company's pycharm.
A, access to JetBrains official website download pycharm, recommended download professional version.
b, you can learn some basic things in the pycharm use tutorial .
4, free activation pycharm
After installing the professional version of the Pycharm, you will find that only 30 days of probation! Need to be activated for permanent use, money to buy? It doesn't exist! Of course there is free hack method, the following is to introduce the free crack method:
(1) Authorization server activation
Select License Server activation, enter the activation code:
http://im.js.cn:8888 or http://idea.java.sx/
or Http://xidea.online but generally useless! It is recommended to use the second type.
(2) Activation Code activation
1. Modify the Hosts file:
The Hosts file path for the Windows system is:
C:\windows\system32\drivers\etc
Add 0.0.0.0 account.jetbrains.com to the end of the Hosts file
because it is a system file, all generally do not have permission to modify, so first copy the Hosts file to the desktop and then modify and save the hosts file in the overwrite system file.
2, enter the Activation code: (This activation code valid time is 2019,5,4)
K71u8dbpne-eyjsawnlbnnlswqioijlnzfvoercue5fiiwibgljzw5zzwvoyw1lijoibgfuihl1iiwiyxnzawduzwvoyw1lijoiiiwiyxnzawduzwvfbwfpbc I6iiisimxpy2vuc2vszxn0cmljdglvbii6ikzvciblzhvjyxrpb25hbcb1c2ugb25sesisimnozwnrq29uy3vycmvudfvzzsi6zmfsc2usinbyb2r1y3rzijp Beyjjb2rlijoisukilcjwywlkvxbubyi6ijiwmtktmdutmdqifsx7imnvzguioijsuzailcjwywlkvxbubyi6ijiwmtktmdutmdqifsx7imnvzguioijxuyis Inbhawrvcfrvijoimjaxos0wns0wncj9lhsiy29kzsi6iljeiiwicgfpzfvwvg8ioiiymde5lta1lta0in0seyjjb2rlijoiukmilcjwywlkvxbubyi6ijiwm Tktmdutmdqifsx7imnvzguioijeqyisinbhawrvcfrvijoimjaxos0wns0wncj9lhsiy29kzsi6ikrciiwicgfpzfvwvg8ioiiymde5lta1lta0in0seyjjb2 Rlijoiuk0ilcjwywlkvxbubyi6ijiwmtktmdutmdqifsx7imnvzguioijetsisinbhawrvcfrvijoimjaxos0wns0wncj9lhsiy29kzsi6ikfdiiwicgfpzfv Wvg8ioiiymde5lta1lta0in0seyjjb2rlijoirfboiiwicgfpzfvwvg8ioiiymde5lta1lta0in0seyjjb2rlijoir08ilcjwywlkvxbubyi6ijiwmtktmdut Mdqifsx7imnvzguioijquyisinbhawrvcfrvijoimjaxos0wns0wncj9lhsiy29kzsi6iknmiiwicgfpzfvwvg8ioiiymde5lta1lta0in0seyjjb2rlijoiu Emilcjwywlkvxbubyi6ijiwmtktmdutmdqifsx7imnvzguioijsu1uilcjwywlkvxbubyi6ijiwmtktmdutmdqifv0simhhc2gioii4ota4mjg5lzailcjncmfjzvblcmlvzerhexmiojasimf1dg9qcm 9sb25nyxrlzci6zmfsc2usimlzqxv0b1byb2xvbmdhdgvkijpmywxzzx0=-owt3/+ldcpedvf0eq8635yyt0+ zltcfihokzsrx5hbtbkgyrpfdrdgqak6ljjexl2emlbcuq729k1+ Uky9js0nx1nh09l9rw4c7k9wuksll6rwx7hcdcma1aholfsp79nynsmzzqqlfohnyjd+ dxfxm5gyd2othya0zyjtnmmajuursapjmp9f1z7utpmplmxs/jacwdyx6qis+funjdpf7bjzyaqbvtbz+ 6sanbgn36gg1b2xhhcctn6we8vagwwsnum70egpahctktohxi7us1jgn9gkar6nbp+8dbfz3a2wd+xof3nsjb/d2f/ 6zjr8yjf8aoyb30kwg3zf5cww==- Miiepjccaiagawibagibbtanbgkqhkig9w0baqsfadaymrywfaydvqqdda1kzxrqcm9mawxlienbmb4xdte1mtewmja4mje0ofoxdte4mtewmta4mje0ofowe tepma0ga1ueawwgchjvzdn5miibijanbgkqhkig9w0baqefaaocaq8amiibcgkcaqeaxcqkq+ zdxlr2mmrybpzgbundmn6oaxixzxiwtmekrjmo/5oufqjbllumsmk0qhfmai37wshyxzcfrcidwxjot4zmnbknlyhoddij/78tmvqfl8noed5+ 07b8veaiu7c3e1n+e1doc6wht4i4+iemtspadoaj5wcqvqbri8ket8m9vcbiwx7fd0fhexfg3zrt0xqwmcxgnp3ddjhio0rcdu+ itv7emtnsvq9jbg1usmsfvmowr25mju2jcpfp1+i4zi+fqgr8gyg8oindyneoabsr3lopi7gRuysvkb/xvy/voklpck2h0f0gjxfjnye8nt1paywoyl7rmiavre/ Ekwidaqabo4gzmigwmakga1udewqcmaawhqydvr0obbyefgepg9ozgcflmgnbky7sghimggtcmegga1udiwrbmd+ afkoetkhnqhi2qb1t4lm0ofkll/ Gzorykgjaymrywfaydvqqdda1kzxrqcm9mawxlienbggka0myxg7kdeeewewydvr0lbawwcgyikwybbquhawewcwydvr0pbaqdagwgma0gcsqgsib3dqebcwu aa4icaqc9wzuygqedsuoc5tousrrigmw4/+wuc5etzbfvdl4ht/8vzmw/oulip4ycva0xkybacj2ix+zcdkopfiyxiasih+ hxapv6j79vvouxkrwg2xv6shftplp+0gpdgq3x9r3+kjbmam8w+fodlwqafjrlvpzmgnedu14ygxiz9bvzmiqbwrba+c/f4tlk/ dv07dsnexihqfoibnqdivntgombau2ddup2gwkdl81ua8eicgnexhe82kjf4zwfadhk3bqvvbfdawxcdy4xbjs3l4raplu3yenszr/oeur1+ jfoxnqsmecmxkxgraq9u55gwjcofkrgoxedek/sk1vfojvs+num4eyerufmfazhzoqiuw4iqggc45ohfh0uuyjycufxxdsu9lmcv8qdhkm+ wnprb0l9l5vxscbduhagyd6ss+ga+ady6f/qxzuuceuoh3qunbbculvisz6+girnt1ka9n2qachl+ 2ybfaquqr8h7z2gsx5lcif5kynsqj0gavxtvywh7pyikx4bs354zqluwwa/cg++2+wnwp+htbhvxmrntdvhsm38aknzld+ ptaswgu9gylmhti2envwgybsd2dxmhxk3ipckhkak+ pl0ewygzwg3tj9mz7sowcxlwdfak0lrjnkgfmtggrwjv8gypw5bq23vmiqqdlgknzuoog==
(3) Crack patch Activation
more trouble, but permanently effective, can be based on Reference website to achieve.
complete the above steps, we can be happy to knock the code, or the old routine, first practice the output of a "hollow Word." The next article on the official start of the Python crawler!
Installation of 1,python crawler environment