Python implements bulk download files

Source: Internet
Author: User
Tags split

Before sharing the Python Multithreaded Crawl Web page, but this can only use Python to crawl to the Web page source code, if you want to be used as a Python download files, the above may not be suitable for you, I recently in the use of Python files to download the time to encounter this problem, But eventually it was resolved, and I sent the code

Python implements bulk download files

?

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 This is the

Other user's method:

?

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 Os.path import basename from urlparse import urlsplit def url2n Ame (URL): Return basename (Urlsplit (URL) [2])   def download (url, localfilename = None): localname = url2name (URL) req = Urllib2. Request (URL) r = Urllib2.urlopen (req) if R.info (). Has_key (' Content-disposition '): # If the response has On, we take the file name from it localname = R.info () [' Content-disposition '].split (' filename= ') [1] if localname[0] = = ' "' or Localname[0] = = "'": LocalName = localname[1:-1] elif r.url!= URL: # If we were redirected, the real file name we take FR Om the final URL localname = Url2name (r.url) If LocalFilename: # We can force to save the file as specified name LocalName = LocalFilename F = open (LocalName, ' WB ') F.write (R.read ()) f.close ()   download (r ' URL address of the python file you want to download ')

These are all the things that this article has to share, and the small partners can test which methods are more efficient.

Related Article

E-Commerce Solutions

Leverage the same tools powering the Alibaba Ecosystem

Learn more >

Apsara Conference 2019

The Rise of Data Intelligence, September 25th - 27th, Hangzhou, China

Learn more >

Alibaba Cloud Free Trial

Learn and experience the power of Alibaba Cloud with a free trial worth $300-1200 USD

Learn more >

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.