1, when crawling data, sometimes encountered by the site, such as IP, response status code of 403, then we hope to be able to throw
The Closespider exception.
2, but as Scrapy official website mentions, scrapy default setting is to filter out the
Http response status code and response status code
From: http://hi.baidu.com/starsecond/blog/item/de75458a3cb1b51ac9fc7a6a.html
========================================================== ==========================================
100
This article mainly describes the Python crawler to solve the 403 Forbidden error related data, the need for friends can refer to the Python crawler to solve the 403 Forbidden error when writing a crawler in Python, Html.getcode () will encounter 403
Status Codes and type status codes of SIP response messagesTemporary response (1xx) 100 trying in process180 ringing181 call being forwarder call forward182 queue181 * session progress session
Successful SESSION (2XX) 200 OK session
7.1 status code OverviewWhen a Web server responds to a request from a browser or another client program, its response is generally composed of the following parts: a status line, several response headers, a blank line, and content documentation.
Status Code Overview The Web server responds to browsers or other customersProgramThe response is generally composed of the following parts: one status line, several response headers, one blank line, and the content document. The following is a
HTTP Status Response code explanation/DaquanThe HTTP status code is a 3-bit numeric code that represents the HTTP response status of the Web server. It is defined by the RFC 2616 specification and is extended by RFC 2518, RFC 2817, RFC 2295, RFC 2774
The HTTP status Code (response code) is used to indicate whether the HTTP request has completed successfully. The HTTP response type is divided into five categories: message response, successful response, redirect, client error, server-side
The more ideal method of interpretation should be defined by the expression pattern of "state: Task (target) + process + performance (or feature)".Full-textIn "Pragmatic Ajax A Web 2.0 Primer" accidentally see the introduction of Readystae state,
SIP Reply Message Status codeand function
Type Status Code status descriptionTemporary response (1XX) trying is in process180 ringing ringing181 Call being forwarder calls are forwardLine queue181* Session Progress Sessions
Session succeeded (2XX)
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.