Scrapy Crawl site displays Filtered offsite request to error

Portal: http://blog.csdn.net/feifly329/article/details/49702063

Cannot crawl when crawling a Web site picture.

To set the logging level in the setting.py file

Log_level= ' DEBUG '

log_file = ' Log.txt '

View Log Discovery Report

2017-08-26 15:00:45 [scrapy] debug:filtered offsite request to ' movie.mtime.com ': <get http://movie.mtime.com /12231/posters_and_images/>

This log is a little strange. Decisive internet Baidu, find the answer

The official explanation for this is that you want the address of the request and the conflict in the Allow_domain (my allow_domains=["http://www.mtime.com"), which is filtered out. You can deactivate the filter function.

Yield Request (URL, Callback=self.parse_item, dont_filter=true)

Scrapy Crawl site displays Filtered offsite request to error