About the Linux download tool

Source: Internet
Author: User
Tags windows download ftp protocol

Reason

Have to say in Windows download since the Thunderbolt has not considered what is BT or electric donkey download, in short, as long as there is nothing thunder, magnet, or ed2k all thrown into the Thunder, Europe, Of course, there are. Torrent seeds, Thunderbolt can be a one-stop solution, coupled with the campus network download speed is not bad, the general resources are 5-600k/s, of course, you are willing to rent a member or something, directly to the speed of 2-5mb/s, so I have been so many small films, cough, Back to the serious.

After switching to Linux I did not pay attention to thunder, because after switching to Linux, there is no download GB-level files, such as high-definition movies or something, the general some software is more than 10 m, and recently in the pursuit of the "a Tiecheng Iron Fortress" a set of 500M, in the browser download Hang the last lesson on the download good, And the speed is not slow. So that I have been using wget download, what Aria2,transmission has not been used, my Kali inside there is only a wget. So I wrote an open source software recommendation inside I also overlooked the download tool this aspect, because there is no demand, but recently demand came, I want to see a Called "The bottom Spice" of the day shadow, however are not found on the Internet HTTP or FTP (movie Heaven that to thunder Client), in short even if I want to hang slowly under the browser can not, let alone I do not want to use the browser hanging slowly download.

In fact, I want to see "The bottom spice" There are several options, the first, directly to the cinema, for the box office to contribute, but the time has gone, not to mention the seemingly Chinese mainland is not released? Second, and so on, and so on all kinds of video website update this movie, then rushed a VIP what, direct online watch, first in know that there is high-definition source outflow, I do not want to wait, and then to the site VIP, for me is almost impossible, so I can only choose third, download ~

I counted the film I found. There are several ways to download it

1.magnet的磁力链接2..torrent结尾的BT种子3.ek2k的电驴链接4.迅雷自家的thunder链接

Very good, so a statistic, all kinds of download protocol See me dazzling, before using the Thunder when there is no tube what is the link, now suddenly come out so much, do not know which good, which fast, the result is to see the film, you have to toss.

P.s. Incidentally, there is a little domestic or good, at least some of the download tools can be fair and aboveboard to run, and even a thunderbolt such a special P2SP company, which in the United States and other countries are very strong copyright awareness is not dare to imagine, but it is because of the domestic small small pipeline, simple http or htp download is simply deadly, In order to supplement, peer even p2sp way to appear so need, I remember not know there are download tools, such as thunder, hang Windows IE and other files download feeling, it is very bad.

Download Agreement

Now I'm just going to do it. The above four download methods report my findings slightly and make a comparison:
(First of all, to clear two basic concepts, ①P2P's core idea is that there is no server concept, any one of the downloader is both client and Server;② when the download from others, called the download, and for others to provide files, called upload)

1.Magnet

Magnetic links (Magnet URI scheme) are computer programs that perform information retrieval and downloading of documents in peer-network, and unlike Uniform Resource Locators (URLs) based on "location" connections, magnetic links are based on metadata (metadata) file content, which is a Uniform Resource name (URN), That is, the magnetic link is not based on the document's IP address or locator, but in the distributed database, through the hash function value to identify, search to download the document.

The draft of this standard appeared in 2002 in order to eDonkey2000 "ed2k:" and Freenet's "Freenet:" Two URI format for "vendor and project Neutrality". The standard also tries to closely follow the official IETF URI standard

The most common use of magnetic links is to link to a specific file based on the value of the hash function of the file content, generating a unique file identifier, similar to ISBN. Unlike regular identifiers, a content hash can be made by any person who holds the file, so there is no need for a central body, which makes it often used as a search condition in the file sharing field, because anyone can distribute a magnetic link to ensure that the resource that the link points to is what he wants, regardless of the way it is obtained. (although technically, two different files may have the same hash value, but in fact this is very unlikely to happen)

Another advantage of magnetic links is openness and cross-platform: a magnetic link can be run on almost all platforms by applications that use the following to download a file. Because magnetic links are concise and plain text, users can easily copy them into e-mail or instant messages, such as seed files.

P.s.magnet the source of each connection is not fixed, it will not be able to seize the source.

2.BT

BitTorrent (BT) is a file distribution protocol in which each downloader continuously uploads downloaded data to other downloads, while in the Ftp,http protocol, each downloader does not interact with each other while downloading the required files. When very many users access and download files on the server at the same time, due to the processing power and bandwidth limitations of the FTP server, the download speed will drop sharply, and some users may not be able to access the server. The BT protocol differs from the FTP protocol in that the more people download, the faster the download, because each downloader downloads the downloaded data to other downloads, taking full advantage of the user's upload bandwidth. With a certain strategy to ensure faster upload speed, download speed is faster. In a very short period of time, the BitTorrent protocol became a new technology of change

The. torrent file is essentially a text file that contains both tracker information and file information. Tracker information is primarily the address of the tracker server that is needed in the BT download and the settings for the tracker server. Its main principle is the need to provide the downloaded file virtual into equal size blocks, the block size must be 2k of the whole number of square (because it is a virtual block, the hard disk does not produce individual block files), and the index information of each block and the hash code is written to the seed file (. torrent). Therefore, the seed file (. torrent) is the "index" of the downloaded file.

Later, DHT network technology was developed, making it possible to download without tracker, and DHT is called distributed hash table (distributed hash table), which is a distributed storage method. Without the need for a server, each client is responsible for a small range of routes and is responsible for storing a small portion of the data for addressing and storing the entire DHT network. Using the BT download software that supports this technology, users can download it without having to connect to the tracker because the software will find and communicate with other users who download the same file on the DHT network and start the download task.

Some software, such as the bit Elf, also automatically searches for seed resources through DHT to form the seed market.

In addition, the DHT algorithm used here is called Kademlia (also used in the emule, often called it Kad, the implementation of the Protocol is different), this technical benefit is very obvious, is greatly reduced the burden of tracker (not even need). Communication can be established more quickly between users (especially when they are not connected to tracker).

3.ed2k

As with most file-sharing networks, it is distributed, and files are transmitted based on point-to-point principles rather than being provided by a hub server. The client program connects to the ED2K network to share files. The ed2k server, as a communication center, helps users find files within the ED2K network. Its client and server can work on Windows, Mac OS, Linux, UNIX and other operating systems. In 2005, a lawsuit against the American Record Industry Association was outlawed by the United States Supreme Court, fined $30 million for RIAA and permanently halted development.

By the European hackers and enthusiasts to crack the ED2K agreement (not authorized by the Metamachine company, not legal) development of MLDonkey, electric mules eMule and other clients are popular, then these compatible clients are: EMule (electric mules), Mldonkey,shareaza, Amule,hydranode,lphant,morpheus,lmule, there are also many domestic compatible clients have appeared, please check the paragraph "Domestic compatible client".

As a ed2k client, MLDonkey's biggest feature is the support for simultaneous connection of multiple servers (Emule,amule, etc.), which can only connect to a single ed2k server, greatly increasing the number of available sources.

4. Thunder (Popular in China)

Peer to peer is based on point-to-point (peer network), one end of the download speed and the other end of the upload speed is closely related, because most Chinese users use ADSL internet, ADSL upload speed is not fast, only dozens of K speed, some users will also artificially limit the upload speed, This leads to a lack of peer-to-peer upload bandwidth resources, so Chinese users will generally feel slower to peer.

P2S (Peer to server) is based on the user to the server, the user directly to a large download site to download files, files stored on the site server, so speed can be guaranteed, usually there will be hundreds of K speed, but the problem is the resources scattered, difficult to search.

The use of P2SP (Peer to Server & peer) is based on user-to-server and user-mechanism, different from peer, and also different from the P2S,P2SP download method actually extends to peer technology, which not only supports peer At the same time also by retrieving the database to the server resources and peer-to integration, the user to download a file, will automatically search for other resources, select the appropriate resources to accelerate, which makes the thunder in the download stability and download speed, than the traditional peer has a very big improvement.

This is the core of the problem is the intelligent resource selection, the user use Thunder to download a file at the same time, Thunder will automatically collect users, and to determine whether the MD5 value is the same file, thus forming a huge download link library, so on the Thunderbolt server side of the integration of resources, When the subsequent users download the same file, the Thunderbolt will be based on the user's specific speed to a fastest server download the same file, because the choice is usually the most optimized results, so users feel that download speed is really very fast.

In general, the small software download station should avoid wasting traffic, avoid hotlinking, but also should do, if not enough traffic support, such as the use of hundreds of yuan of virtual host, do not provide a large number of file download, otherwise it will certainly be dragged down. However, the strategy of large software download station can be different, not necessarily to save traffic, because usually large download station will host a separate server, with a certain bandwidth guarantee, as long as not put some large files, usually no traffic overrun, then do not care about this p2sp behavior of thunder, and can use Thunder to do some ads, if the traffic is too large, you can directly use the fourth method mentioned above, limit the number of connections to download space to reduce server load

Personal understanding: Thunderbolt is a combination of the characteristics of the p2s,p2p, to maximize the limit to find the source of download, but he does not upload, or upload very little, or even just in the Thunder User Circle upload, do not feedback to peer-to network, then "hotlinking" and "blood-sucking donkey" so come.

P.s. Yes, what you see on the Zhon Wen Wikiri side is basically the same as above, I just made a deletion and refinement, and I hereby make a statement here.
Spit Groove A sentence: Although the content is wiki, and the Chinese wiki on the introduction of these three are very comprehensive, but I did not see the three (Thunderbolt is p2sp) peer download method put together to make a comparison, then no comparison, in fact, magnetic links, BT and electric donkey in my opinion are very like good:-)

Actual Download tool

So the next step is to talk about the actual download tool under Linux:
(Linux download tools to make your headache, but in fact, the download of the software download protocol is still not open the above mentioned several peer-to-peer protocol):

1.Wget
2.BitTorrent (original)
3.Transmission
4.Uget (CURL+ARIA2)
5.KTorrent
6.μtorrent
7.amule/emule
8.MLDonkey
9.flashget
9.xware– Thunderbolt Replacement Program

1.Wget

wget is a CLI download tool, almost all Unix like the platform has it, small and lightweight, and listed above other download tools, it is not based on the peer-to, it is currently supported through the HTTP,HTTPS, and FTP these three most common TCP/IP protocol protocol download, That is, the way it is downloaded is p2s.

Its most powerful place is the-R (recursive recursion) this option, meaning that you can download all the links referenced in the Request URL page, almost every web page will refer to the URL, so basically-R after the download will continue to do, but its disadvantage is that there are fewer protocols supported, In particular, curl compared to the popular streaming protocol MMS and RTSP are not supported, there is also a wide range of use of the various peer-to protocol is not involved.

The conclusion is that if you just do a non-peer download, wget one is enough.

2.BitTorrent (original)

I have not used this software, but see an introduction is very good, copied.
First of all, probably many people do not know BitTorrent this BT download software, the most widely known in China is the bit comet (BitComet) bit Elf (Bitspirit), as well as the domestic famous drop rogue download software thunderbolt. Of course like pt download and BT download enthusiasts estimate also know foreign drops a new BT, PT Software μtorrent, domestic now more and more like to download BT friends know μtorrent This software is very useful, download fast, stable, Very little resource usage (less than 10MB of memory footprint) download foreign BT seeds with μtorrent speed, Thunderbolt but completely no speed (foreign no one knows China thunder, foreign seeds do not know thunderbolt) because of the above reasons domestic use μtorrent more and more friends, But few people in the country know that in fact μtorrent this software is just "U.S. BitTorrent Company for its BitTorrent bt download software (also the world's first BT download software, the true ancestor of BT download software) for new version, new features, Test and acquired a subsidiary, in other words μtorrent is only BitTorrent beta or "cut", and because UTorrent is the first to give BitTorrent test new version, new features of the software. Stability, bugs, all aspects are much worse than BitTorrent

3.Transmission

is a BitTorrent client, characterized by a cross-platform backend and a concise user interface on it, transmission licensed under the MIT License and the GNU General Public License dual license, so it is a free software that supports magnet.

4.Uget (CURL+ARIA2)

In fact, curl and ARIA2 is also a separate two download tools, uget both can be integrated call at the same time, so put it together here said

CURL

Curl is a file transfer tool that works under the CLI using URL syntax, which was first released in 1997. It supports file uploads and downloads, so it's a comprehensive transfer tool, but traditionally, curl is used as a download tool, and curl also contains libcurl for program development.

The communication protocols supported by Curl are FTP, FTPS, HTTP, HTTPS, TFTP, SFTP, Gopher, SCP, Telnet, DICT, FILE, LDAP, LDAPS, IMAP, POP3, SMTP, and RTSP.

Aria2

ARIA2 is also a download tool that works under the CLI, supporting Http/https, FTP, SFTP, BitTorrent and Metalink communication protocols.

Uget

GUI Tools

(To be added: There is also a variety of download tools in the domestic conditions of the evaluation, as well as Linux under the implementation of the Thunderbolt [Xare?], but also some of the common Linux software added to the description [Sogou Input method? ]....)

End

The above specific P2S,P2P,P2SP download tool due to limited time and energy, just do a partial enumeration, if you have other good tool experience, may wish to write in the following comment area ~
This article is basically all about downloading things, and some other open source software actually I also have summed up, http://blog.csdn.net/qq_29245097/article/details/51511145, this is my previous recommendation article, hope can help you.

About the Linux download tool

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.