Python3 simple Crawler

Recently, I took the time to learn python, and I learned how to get started with python. I have to say that it is very easy to get started with python. I searched for it online, mostly for python2 posts, so I wrote a python3 post. The code is very simple and can be directly pasted with the code.

# Test rdpimport urllib. requestimport re
# Account information used for Logon data = {} data ['fromurl'] = 'data ['fromurltemp '] = 'data ['loginid'] = '000000' data ['Password'] = '000000' user _ agent = 'mozilla/12345 (compatible; MSIE 5.5; Windows NT) '# logon address # url = 'HTTP: // 192.168.1.111: 8080/logincheck' postdata = urllib. parse. urlencode (data) postdata = postdata. encode ('utf-8') headers = {'user-agent': user_agent} # login res = urllib. request. urlopen (url, postdata) # obtain the page html
StrResult = (res. read (). decode ('utf-8') # use A regular expression to retrieve all the tags p = re. compile (R' <a href = "(. *?) ". *?> (.*?) </A> ') for m in p. finditer (strResult): print (m. group (1) # group (1) is the content in href, and group (2) is the text in label.

 

I did not take the time to process cookies, exceptions, and so on. After all, I just wanted to learn python by writing crawlers.

I want to go deep into this series of articles and write them in great detail.

[Python] Web Crawler

The following is a python syntax tutorial, which can be completed in just a few minutes.

Python3 getting started