Download patches from IBM with wget multithreading

Scenario: Bim's system patch downloads will tell you an FTP server address and directory that is required to patch the file link instead of the actual file, such as lrwxrwxrwx 1 17590 446 June 20:34 72.BFF-&G T /AIX/FIXES/BYCOMPID/5765E6200/BOS.RTE/BOS.RTE.AIO.5.2.0.75.BFF. Such links, in Linux with the ftp login after get/mget download, the filename is a link name, the contents of the actual file, at this time the download is successful.

Question 1: If you download more files, use get way to download slow and not insurance, once the broken off again download is very troublesome, because you do not know where to go.

Problem 2:IBM Download site logon time is very long, it takes about 4 minutes to appear in the login screen, such a time for most Windows FTP software timeout, such as CUTEFTP,SMARTFTP does not set the timeout configuration, FTPRush maximum time of 200 seconds.

Problem 3:windows Explorer can be logged in, but a file must be saved as a file for download, FLASHXP can set a long timeout and can log in, but downloading to a file is a linked file, not an actual file. Wget can also be downloaded, but it is also a download link file rather than an actual file.

Workaround: Wget is not affected by the logon time, the actual connection address can be based on the connection file, wget can be called by the shell script. So get the connection file first, then get the connection address, and then use the shell Loop call wget (much faster than the FTP get), you can quickly download.

The code shows, for example, where Files.txt is the downloaded connection address, and totalrunning represents the number of processes at the same time.
Input=files.txt
Logfile=wgetibm.log
totaltasknum= ' WC $INPUT | awk ' {print '} '
Dotasknum=0
totalrunning=10

Echo Total task is $totaltasknum

For file in ' awk ' {print $11} ' $INPUT '
Todo
Url=ftp://www7b.boulder.ibm.com$file
Tmppn= ' Ps-ef | grep wget | Grep-v grep | WC | awk ' {print '} '
echo wget processes count: $tmppn
While [$tmppn-ge $totalrunning]
Todo
echo wait for the process release ...
Sleep 10
Tmppn= ' Ps-ef | grep wget | Grep-v grep | WC | awk ' {print '} '
Done
echo begin wget from URL $URL
Nohup wget ftp://www7b.boulder.ibm.com$file >> $LOGFILE &
Done