XPath for Python network data collection

This article explains how to use XPath in scrapy to get the various values you want

Using watercress as an example

Https://book.douban.com/tag/%E6%BC%AB%E7%94%BB?start=20&type=T

You can verify that your XPath is correct in conjunction with the Plugin XPath helper in Chrome.

Here I want to get the title in the href and a tag under the a tag, use the Extract_first () in the red box in the picture, notice the syntax of the XPath here, "." In front of it, otherwise the query will start from the document root node instead of the current node .

If you want to get the text value within the tag, use/text () to

XPath for Python network data collection