Linux under the multithread download tool __linux

Source: Internet
Author: User
Tags bz2
Multi-threaded Download tool under Linux

Myget [Recommended]
The Myget goal is designed as an extensible, rich-Interface multithreaded download tool that supports protocols such as HTTP, FTP, and HTTPS.
Download the latest version of 0.1.0 in http://myget.sourceforge.net/release/myget-0.1.0.tar.bz2,

After downloading use the following command to install:
#tar JXVF myget-0.1.0.tar.bz2
#cd myget-0.1.0
#./configure
#make
#make Install
The Myget command format is as follows: #mytget [options] [download address]
Common options:
-d [Directory]: Specifies where the downloaded files are stored locally, the default current directory.
-F [File]: Specifies the name of the new file to be downloaded locally.
-H help option.
-N [Threads]: Number of downloaded threads, defaults to 4.
-X [Proxy server address]: Set proxy server address, such as "-X http://user:pass@host:port".
-B Show the debug message
-C Set The retry count to [num], no limit when ' 0 ', the default is ' 99 '
-I Set the FTP retry interval to [num] seconds, the ' default is ' 5 '
-R include ' Referer: [URL] ' header in HTTP request.
-T Set the connection timeout to [num] seconds, the ' default is ' 30 '
-V Show the version of the Myget and exit
-X Set the proxy [URL]

[Root@localhost myget-0.1.0]# mytget-n 10-x http://192.168.0.5:8080-d./http://..../myget-0.1.0.tar.bz2
Begin to DOWNLOAD:MYGET-0.1.0.TAR.BZ2
filesize:222k
100% [==========================================================================================] [228K] [5.6K/s] [Eta:00:-1] Download successfully in 00:11
===========================================================
Axel [Recommended]
Axel is a multithreaded download tool on the command line that supports the continuation of a breakpoint, which is usually wget several times.
can be downloaded at http://www.linuxfans.org/nuke/modules.php?name=Site_Downloads&op=mydown&did=1697.

After downloading, compile the installation using the following command:
#tar ZXVF axel-1.0a.tar.gz
#cd axel-1.0a/
#./configure
#make
#make Install

The basic usage is as follows: #axel [options] [download directory] [download address]
[Root@localhost axel-1.0a]# Axel--help
Usage:axel [Options] url1 [url2] [url ...]
-S X Specify maximum speed (bytes per second)
-n x Specify maximum number of connections
-o f Specify local output file
-S [x] Search for mirrors and download from x servers
-N Just don ' t use any proxy server
-Q Leave stdout alone
-V More status information
-A Alternate progress indicator
-H This information
-V Version Information
A typical download is as follows: #alex-n 10-o/home/kennycx/http://xxxx/jre.tar.gz
Download the file of the specified path to the/home/kennycx/directory with 10 threads.
#设置代理 [root@localhost axel-1.0a]# export http_proxy=192.168.0.5:8080
#开始下载 [root@localhost axel-1.0a]# axel-n 10-vo. Http://xxx/xx.tar.gz
Initializing download:http://xxx/xx.tar.gz
File size:1945089 bytes
Opening output file./d4x-2.5.6.tar.gz
Starting download
[0%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [15.3KB/S]
[2%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [20.5KB/S]
[5%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [26.3KB/S]
[7%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [30.1KB/S]
[10%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [34.0KB/S]
[13%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [36.7KB/S]
[15%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [39.0KB/S]
[18%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [41.7KB/S]
[21%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [42.7KB/S]
[23%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [43.2KB/S]
[26%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [44.6KB/S]
[28%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [46.6KB/S]
[31%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [46.6KB/S]
[34%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [46.2KB/S]
[36%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.5KB/S]
[39%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.3KB/S]
[42%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.9KB/S]
[44%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [48.0KB/S]
[47%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.2KB/S]
[50%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.6KB/S]
[52%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.2KB/S]
[55%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.5KB/S]
[57%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.8KB/S]
[60%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.6KB/S]
[63%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.8KB/S]
[65%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [48.0KB/S]
[68%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [48.0KB/S]
[71%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [48.3KB/S]
[73%] ....... ....... ....... ....... ....... ...
Connection 1 finished
,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, .......
Connection 3 finished
,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,... [48.1KB/S]
[76%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [48.2KB/S]
[78%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.9KB/S]
[81%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [47.8KB/S]
[84%] ..........
Connection 6 finished
,,,,,,,,,, ,,,,,,,... ..........
Connection 5 Finished
,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ..........
Connection 2 finished
,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, .......... [47.1KB/S]
[86%] .....
Connection 8 finished
,,,,.....
Connection 4 Finished
,,,,,,,,,.  .......... .......... .......... .......... [43.6KB/S]
[89%] ........ ....... ....... ....... ....... ...
Connection 9 finished
,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,......
Connection 0 Finished
,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,... [40.3KB/S]
[92%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [35.0KB/S]
[94%] ..... ....... ...... ...... ...... ..... ....... ..... ..... ... [27.1KB/S]
[97%] ....... ....... ....... ....... ...... ...... ....... ...
Downloaded 1899.5 kilobytes in 1:14 seconds. (25.60 kb/s)
=========================================================
D4x Downloader for X (referred to as d4x in the text) is a powerful graphical download tool under Linux.
Supports HTTP and FTP protocols,
With multiple threads such as netant and FlashGet,
Breakpoint Continuation Download
With a connection Timeout breakpoint continued to pass
Record Download Log
Analog Downloads
Link drag and drop download
Automatically copy clipboard link to download Address bar medium feature.
1. Download and install d4x download address for http://www.krasu.ru/soft/chuchelo/files/d4x-2.5.0final.tar.gz, after downloading use the following command to install:
#tar ZXVF d4x-2.5.0final.tar.gz
#cd d4x-2.5.0final
#./configure
#make
#make Install
After a successful installation, run the "d4x" command to run directly. Its interface, as shown in Figure 3, is a bit like flashget.
2. Use and Setup
D4x is very simple to use, when downloading a file, simply enter the download file address in the Add New Download Task dialog box. If the download address requires a username and password, you can enter it directly in this dialog box. To schedule a download, you can set the download time in the time option. In addition, in the download task options, you can set some of the downloaded configuration, such as the download file default directory, the number of default threads, interface style and so on. It is worth mentioning is the proxy option, you can specify the default proxy server and SOCKS5 proxy, as shown in Figure 4.

=========================================================
MMS Protocol Streaming Media Download tool
[Source]http://www.5anet.com/?module=bbs&object=bbs&action=showdetail&id=13
[Author] Yellow leaf
Asfr+ is a tool designed to download ASF, WMA, and WMV format streaming files. This software is the domestic Yaan2 in the Asfrecorder code based on the improvement made, the software on the basis of the asfrecorder added a break download, repair damage ASF Files, multithreading download ASF files, breakpoints, such as the function of continuous transmission. The only regret is that there is no GUI interface.
Installation method: Tar zxvf asfrplus.tgz
CD Asfrplus
Make
An executable file named "ASFR" is generated in the Asfrplus directory.
The following are its basic uses:
Enter the Asfrplus directory, type:
./ASFR Mms://www.hehe.com/***.wma-t 3
Download ***.wma with 3 threads
./asfr-p http://proxy:8080
mms://www.hehe.com/***.wma
Use proxy server proxy:8080 download ***.wma
./ASFR
Mms://www.hehe.com/***.wma-t
Forced to download ***.wma with MMST protocol
Exit Program: Ctrl+break

Size:
47KB
Download:
Http://www.5anet.com/software/asfrplus.tgz
=========================================================
1) Graphics Interface Download Tool

D) Wxdfast
Wxdfast is also a graphical download tool, supporting multithreading, breakpoint continued transmission and other functions, the biggest feature is the fast download speed. The latest version of Wxdfast can be downloaded at http://heanet.dl.sourceforge.net/sourceforge/dfast/wxdfast-0.2.1-src.tar.gz. Then install it using the following command:
#tar JXVF wxdfast-0.2.1d.tar.bz2
#cd WXDFAST-0.2.1-SRC
#make Install
Run the./wxdfast command under the terminal to run the program. The Wxdfast interface is very concise and its interface is shown in Figure 5. All the English interface may not be as convenient as kget, fortunately its operation and Kget, d4x basically the same, we can refer to learning, here is not to repeat.

E) Aria
Aria is a compact, multi-threaded download tool that is handy for easy and easy-to-use interfaces.
You can download the latest version in Http://aria.rednoah.com/download_e.html, and then use the following command to compile the installation:
#./configure
#make
#make install successfully installed, run the following command directly to run Aria:
#aria &
The ARIA interface, as shown in Figure 6, operates almost as much as d4x and can be referenced using.

2) command line download tool
The command line download tool is recommended for friends who prefer command line operations to high speed downloads. command line tools are not only easy to use, but most have a high download speed and download efficiency, especially suitable for mass download files. Here is a detailed description of these tools.
A) Wget
Wget is a very common command-line download tool, and most Linux distributions include this tool by default.

If no installation is available, download the latest version in http://www.gnu.org/software/wget/wget.html and compile the installation using the following command:
#tar ZXVF wget-1.9.1.tar.gz
#cd wget-1.9.1
#./configure
#make
#make Install
Its usage is very simple, the wget uses the format as follows: #wget [option] [download address]

wget Common parameters
-B: Background download, wget the default is to download the file to the current directory.
-O: Downloads the file to the specified directory.
-P: Creates a directory of the specified name before saving the file.
-T: Try the number of connections, how many attempts to connect when wget cannot establish a connection to the server.
-C: Breakpoint Continuation, if the download is interrupted, then the connection recovery will be downloaded from the last breakpoint.
HTTP and FTP agent, edit its configuration file "/etc/wgetrc". The specific method is to use the VI Editor to open the above file, the "Http_proxy" and "Ftp_proxoy" before the # removed, and then in these two entries after the corresponding proxy server address, save exit can be.
Wget can also download the entire Web site, such as downloading Http://man.chinaunix.net's entire Man Handbook Center. Simply enter the following command: #wget-R-p-np-k http://man.chinaunix.net
Where the-R parameter refers to the use of recursive downloads,
-P refers to all the files that are needed to display the full page, such as pictures,
-NP refers to not searching the upper directory, and K refers to converting an absolute link to a relative link.
B Prozilla Prozilla is also a very popular command line download tool that supports multi-threaded downloads and breakpoint continuation, but no proxy support is available to http://prozilla.genesys.ro/ Download the latest 1.3.7.4 installation package and install it using the following command: #tar zxvf prozilla-1.3.7.4.tar.gz prozilla-1.3.7.4 #./configure #make #ma The KE install prozilla command format is as follows: #proz [parameters] [download address] Common options are:-k=n: set n threads to download.      The number of threads is specified without this parameter, and the Prozilla defaults to 4 thread downloads.      -P,--directory-prefix=dir: Specifies that the downloaded file is saved in the dir/directory. -R,--resume: Continue downloading of unfinished files. If you want to specify the number of threads you can download the following command: #proz-k=5 http://64.12.204.21/pub/mozilla.org/firefox/releases/1.0/linux-i686/zh-CN/     firefox-1.0.installer.tar.gz This will download the file with 5 threads and save the file to the current directory. As with wget, Prozilla also provides a continuation of the function, download interrupted, re-enter the above command, you will be prompted to continue the transmission, press R key can be continued to download. D Linuxdown Linuxdown is a command-line multi-threaded download tool that supports up to 30 thread downloads, but does not find proxy support
Download the latest version of 1.1.0 in Https://gro.clinux.org/frs/download.php/1015/linuxdown-1.0.0.tar.gz.
Then compile the installation using the following command:
#tar ZXVF linuxdown-1.1.0.tar.gz
#cd dandelion/
#make
#make Install Linuxdown

Format is: #linuxdown [download Address] [options] [Number of threads]
Note that both the download address and the options require a Latin quotation mark, and the number of threads cannot exceed 30. A typical download is as follows:
#linuxdown "Http://xxx/xxx.zip" 30
=================================================================
CPU ratio when downloading the same program
PID USER PR NI virt RES SHR S%cpu%mem time+ COMMAND
14549 Root 0 70660 17m 9780 R 73.1 1.8 2:59.92 Wxdfast
14558 Root 0 152m 18m 10m S 2.9 2.0 0:04.43 d4x
Download speed Comparison
[Root@localhost desktop]# mytget-n 10-x http://192.168.0.5:8080-d./http://www.krasu.ru/soft/chuchelo/files/ D4x-2.5.6.tar.gz
Begin to Download:d4x-2.5.6.tar.gz
Filesize:1.9m
100% [===============================================================================> =========] [1.9M] [7.3K/ S] [eta:00:00]
Download successfully in 01:18
[Root@localhost desktop]# mytget-n 10-x http://192.168.0.5:8080-d./http://www.krasu.ru/soft/chuchelo/files/ D4x-2.5.6.tar.gz
Begin to Download:d4x-2.5.6.tar.gz
Filesize:1.9m
100% [==================================> =======> =============================================] [1.9M] [ 4.7K/S] [eta:00:00]
Download successfully in 01:21
[Root@localhost desktop]# axel-n 10-o./http://www.krasu.ru/soft/chuchelo/files/d4x-2.5.6.tar.gz
Initializing download:http://www.krasu.ru/soft/chuchelo/files/d4x-2.5.6.tar.gz
File size:1945089 bytes
Opening output file.//d4x-2.5.6.tar.gz
Starting download
.........
Downloaded 1899.5 kilobytes in 2:11 seconds. (14.47 kb/s)
[Root@localhost desktop]# axel-n 10-o./http://www.krasu.ru/soft/chuchelo/files/d4x-2.5.6.tar.gz
Initializing download:http://www.krasu.ru/soft/chuchelo/files/d4x-2.5.6.tar.gz
File size:1945089 bytes
Opening output file.//d4x-2.5.6.tar.gz
Starting download
..............
Downloaded 1899.5 kilobytes in 1:22 seconds. (23.06 kb/s)
Results: Myget is faster/more stable than Axel
Author: Chen Jie
Finishing: CNSCN
[Source]: http://www.ossw.com.cn/bencandy.php?id=130
Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.