Original Using Scrapyd+supervisor management crawler under Ubuntu

1, installation Scrapyd

Pip Install Scrapyd

2. Install Scrapyd client Scrapyd-client

Pip Install Scrapyd-client

3, install supervisor. Be sure to add sudo here, otherwise the installation will fail. I am the root user login, do not know why must add sudo?

sudo pip install Supervisor

4. Create a Supervisor configuration file

echo_supervisord_conf >/etc/supervisord.conf

5. Add the following at the end of the Supervisor configuration file/etc/supervisord.conf

[Include]files =/etc/supervisor/*.conf

5, create the project configuration file scrapyd.conf under directory/etc/supervisor/, refer to the following configuration

[Program:scrapyd]command=scrapydautorestart=true

Original Using Scrapyd+supervisor management crawler under Ubuntu