Installing Scrapy Tutorials

Scrapy, a Python-based web crawler framework that crawls information from the Web, is a good way to get data. So I want to install the next look.

Go to its official website, install the introduction page

There are 3 kinds of loading method, one is from Pip, one is compiled from source, one is from Conda

According to the previous knowledge, PIP is already integrated in the Python Package management tool, the most simple and clear, ignoring the website introduction interface of a sentence

Note that sometimes the require solving compilation issues for some scrapy dependencies depending on your operating s Ystem

As a result, many errors are reported during the compilation phase, and one more is resolved.

Then give up, compiled from the source code, like Pip, is a bunch of compilation errors.

No way, go to see Conda, downloaded a miniconda,60 more M bar. A careful study turned out to be cool.

Perhaps Python has also noticed that its packages need to be compiled, compiled, and dependent on the environment configuration of its own OS, which often goes wrong.

Miniconda is an integrated environment already installed Python, equivalent to download the installation of the Miniconda is the download of the basic Python core program, and then through the Conda command to download the Conda already compiled package to do the function extension. That is, the Scrapy package, and the lxml,twisted that it relies on, have been compiled with my half-dead package. Just download it and use it directly.