Install scrapy under Windows

Source: Internet
Author: User

Objective

Recently there is a reptile demand, actually played a bit before, but all just stop at the extent of the tool will be used, and then prepare to delve into the system to learn Python crawler.

When it comes to Python crawlers, it is the famous Scrapy crawler frame. However, if you are just getting started, I suggest that there is no need to get into the frame class too early, and try to use some simple tool libraries that will help you understand the principles of crawlers.

Just my personal habits, after the installation of Python will have to install scrapy together, because I always feel that I will use it sooner or later, so the first to pretend.

Before the installation of Scrapy is all the way bumpy, not so easy, especially in Windows installed Scrapy is a variety of problems, but did not expect this is not how to encounter problems, probably found the right posture.

Installation steps

1. Install Python

Learning reptiles, it is best to start from the classic version 2.7, the installation process is very simple, do not repeat it.

Throw a link: https://www.python.org/downloads/release/python-2712/

2. Installing VCForPython27

Using scrapy under Windows requires VC2012 or 2010, but it's overkill to install such a huge thing for a scrapy, so you can choose a version for Python: VCForPython27

: https://www.microsoft.com/en-us/download/details.aspx?id=44266

Remember to restart the system after installation

3. Installing lxml

Installation tutorial See: http://blog.csdn.net/g1apassz/article/details/46574963

4. The final step

Pip install scrapy is done!

Install scrapy under Windows

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.