HTML parsing module of Python crawler module

This is relatively simple, there is nothing to emphasize, if the JSON is returned directly according to the key value, if the page is to use the HTML lxml module XPath parsing.

From lxml import htmlimport jsonclass getnodelist ():    def __init__ (self):        self.getdivxpath= "//div[@class = ' Demo '] "    def use_xpath (self,source):        If Len (source):            root=html.fromstring (source) #html转换成dom对象            Nodelist=root.xpath (Self.getdivxpath) #对dom对象进行xpath解析            If Len (nodelist):                return nodelist            return None                def use_json (self, source,keyname):        If Len (source):            jsonstr=json.loads (source)            value= Jsonstr.get (keyname) #根据具体的键值修改            If Len (value):                return value            return None

　　

HTML parsing module of Python crawler module