Python checks URLs for normal access

53008439

Today, the project manager asked me a question, asked me here are 2000 URLs to check whether it can open, in fact, I was refused, I know because to write code, just learned a little python, a think, Python processing easy, chose Python, began to think good:

1. First 2000 URLs. Can be placed within a txt text

2. Use Python to put the URL within the content into the array in one line

3. Open a simulated browser to access it.

4. If normal access is output normal, error output error

Direct simple brute-dump code. Because of the privacy involved, the picture was coded

2. Import Urllib.request
4. Import Time
8. Opener = Urllib.request.build_opener ()
10. Opener.addheaders = [(' user-agent ', ' mozilla/49.0.2 ')]
12. #这个是你放网址的文件名, just make it right.
14. File = open (' test.txt ')
16. lines = File.readlines ()
18. Aa=[]
20. For line in lines:
22. Temp=line.replace (' \ n ',')
24. Aa.append (temp)
26. Print (AA)
30. Print (' start check: ')
32. For A in AA:
34. Tempurl = A
36. Try:
38. Opener.open (Tempurl)
40. Print (tempurl+' no problem ')
42. except Urllib.error.HTTPError:
44. Print (tempurl+' = Error accessing page ')
46. Time.sleep (2)
48. except Urllib.error.URLError:
50. Print (tempurl+' = Error accessing page ')
52. Time.sleep (2)
54. Time.sleep (0.1)

Python checks URLs for normal access