Linux Curl (reproduced)

Http://www.linuxidc.com/Linux/2008-01/10891.htm

--------------------------------------------------

Linux Curl Usage Brief Introduction
[Date: 2008-01-29] Source: Linux commune Notech

Curl is the next most powerful HTTP command-line tool in Linux, and it's very powerful.

1) Apart, let's start from here!

$ Curl Http://www.linuxidc.com

After the carriage return, the www.linuxidc.com HTML is splinters on the screen ~

2) Well, if you want to save the reading page, do you want to do this?

$ Curl http://www.linuxidc.com > page.html

Sure, but don't be so troublesome!

With Curl's built-in option, save the HTTP result, using this option:-O

$ Curl-o page.html http://www.linuxidc.com

This way, you can see a download page progress indicator appears on the screen. When we get to 100%, it's OK.

3) What what?! Not accessible? It must be that your proxy has not been set.

Using Curl, this option allows you to specify the proxy server and its port to use for HTTP access:-X

$ curl-x 123.45.67.89:1080-o page.html http://www.linuxidc.com

4) It's annoying to visit some websites, and he uses cookies to record session information.

Browsers like Ie/nn, of course, can easily handle cookie information, but what about our curl? .....

Let's learn this. Option:-D <-This is to put the cookie information inside the HTTP response into a special file.

$ curl-x 123.45.67.89:1080-o page.html-d cookie0001.txt http://www.linuxidc.com

This way, when the page is saved to page.html, the cookie information is stored in the cookie0001.txt.

5) So, how do you continue to use the cookie information you left last time you visit? Be aware that many websites rely on monitoring your cookie information to determine whether you are not visiting their website by the rules.

This time we use this option to append the last cookie information to the HTTP request:-B

$ curl-x 123.45.67.89:1080-o page1.html-d cookie0002.txt-b cookie0001.txt http://www.linuxidc.com

In this way, we can almost simulate all the IE operation, to visit the Web page!

6) Wait a minute ~ I seem to forget something ~

That's right! is browser information

Some annoying websites always want us to use certain browsers to access them, sometimes even more so, to use certain versions of NND, where there is time to find these weird browsers for it!?

Fortunately, Curl provides us with a useful option that allows us to arbitrarily specify our own browser information as claimed by this visit:-A

$ curl-a "mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) "-X 123.45.67.89:1080-o page.html-d cookie0001.txt http://www.linuxidc.com

In this way, the server side to the requirements of access, will think you are a running on Windows 2000 IE6.0, hehe Hey, you may actually use an apple machine!

and "mozilla/4.73 [en] (X11; U Linux 2.2; i686 "You can tell each other that you are running Linux on a PC with the Netscape 4.73, huh huh?

7) Another common restriction method on the server side is to check HTTP access referer. For example, you first visit the homepage, and then access the download page specified in the, this second access to the Referer address is the first successful access to the page address. In this way, the server side as long as the download page to find the Referer address of a visit is not the address of the homepage, it can be concluded that it is a stolen company ~

I just want to steal ~!!.

Fortunately, Curl gives us the option to set Referer:-E

$ curl-a "mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0) "-X 123.45.67.89:1080-e" mail.linuxidc.com "-O page.html-d cookie0001.txt http://www.linuxidc.com

In this way, you can cheat each other's server, you are from the mail.linuxidc.com click on a chain took over, oh hehe

8) Write a note that says something important is missing! ——-use curl to download files

Just now, download the page to a file, you can use-o, download the same file. Like what

$ Curl-o 1.jpg Http://cgi2.tky.3web.ne.jp/~zzh/screen1.JPG

Here we teach you a new option:-O caps, so use:

$ Curl-o Http://cgi2.tky.3web.ne.jp/~zzh/screen1.JPG

In this way, you can follow the file name on the server, automatically exist locally!

Another better use.

If Screen1. There are also screen2.jpg and screen3 outside of JPG. JPG 、....、 Screen10. JPG needs to be downloaded, is it difficult for us to write a script to complete these operations?

Don't do it!

In curl, this is the way to write:

$ Curl-o http://cgi2.tky.3web.ne.jp/~zzh/screen[1-10]. Jpg

Oh, what a bad, huh?! ~

9) Again, we continue to explain the download!

$ Curl-o http://cgi2.tky.3web.ne.jp/~{zzh,nick}/[001-201]. Jpg

The resulting download is

~zzh/001.jpg

~zzh/002.jpg

...

~zzh/201.jpg

~nick/001.jpg

~nick/002.jpg

...

~nick/201.jpg

Is it convenient enough? hahaha

Hey? It's too early to be happy.

Because the Zzh/nick under the file name are 001,002...,201, downloaded files with the same names, the back of the previous files are covered out ~

It's OK, we have more ruthless!

$ Curl-o #2_ #1.jpg http://cgi2.tky.3web.ne.jp/~{zzh,nick}/[001-201]. Jpg

-This is ..... Custom file name download? -The enemy, hehe!

In this way, the custom download down the file name, it becomes this: the original: ~zzh/001.jpg--> after download: 001-zzh. JPG Original: ~nick/001.jpg--> after download: 001-nick. Jpg

In this way, not afraid of the file name, hehe

9) continue to download

We usually on the Windows platform, flashget such a tool can help us to block parallel download, but also can be disconnected to continue transmission. Curl in these areas also do not lose to who, hehe

For example, we download screen1. JPG, and suddenly dropped, so we can start the continuation.

$ curl-c-O Http://cgi2.tky.3wb.ne.jp/~zzh/screen1.JPG

Of course, you don't have to take a flashget download half of the files to fool my other download software half of the file may not be able to use OH ~

Block download, we can use this option:-R

Examples Show

For example, we have a http://cgi2.tky.3web.ne.jp/~zzh/zhao1.MP3 to download (Miss Zhao's telephone recitation:D We can use this command:

$ curl-r 0-10240-o "Zhao.part1" http:/cgi2.tky.3web.ne.jp/~zzh/zhao1. MP3 &\

$ curl-r 10241-20480-o "Zhao.part1" http:/cgi2.tky.3web.ne.jp/~zzh/zhao1. MP3 &\

$ curl-r 20481-40960-o "Zhao.part1" http:/cgi2.tky.3web.ne.jp/~zzh/zhao1. MP3 &\

$ curl-r 40961--O "Zhao.part1" http:/cgi2.tky.3web.ne.jp/~zzh/zhao1. MP3

This will allow you to download the tiles. But you need to merge these broken files yourself. If you use UNIX or Apple, use cat zhao.part* > Zhao. MP3 can be used if it is windows, with copy/b to solve it, hehe

The above is the HTTP protocol download, in fact, FTP can also be used. Usage,

$ curl-u name:passwd Ftp://ip:port/path/file

or familiar to everyone.

$ curl Ftp://name:[email protected]:p ort/path/file

10) said the download, the next natural to upload the option is-t

For example, we send a file to ftp:

$ curl-t localfile-u name:passwd ftp://upload_site:port/path/

Of course, uploading files to an HTTP server can also be like

$ curl-t LocalFile http://cgi2.tky.3web.ne.jp/~zzh/abc.cgi

Note that at this time, the protocol used is the put method of HTTP

Just said put, hey, naturally let the old service think up the other several methos have not said it! Neither get nor post can be forgotten.

HTTP submits a form, more commonly used is the post mode and get mode

The Get mode does not use any option, just write the variable in the URL can be like:

$ Curl http://www.linuxidc.com/login.cgi?user=nickwolfe&password=12345

The option for Post mode is-D

Like what

$ curl-d "user=nickwolfe&password=12345" http://www.linuxidc.com/login.cgi

It is equivalent to sending a login request to this site ~

In the end to use the Get mode or post mode, the opposite server to see the program settings.

It is important to note that file uploads on files in post mode, such as

<form method= "POST" enctype= "Multipar/form-data" action= "http://cgi2.tky.3web.ne.jp/~zzh/up_file.cgi" >

<input Type=file name=upload>

<input type=submit name=nick value= "Go" >

</form>

Such an HTTP form, which we want to emulate with curl, is the syntax:

$ curl-f [email protected]-F Nick=go http://cgi2.tky.3web.ne.jp/~zzh/up_file.cgi

Ro-Ro said so much, in fact, curl still has a lot of tricks and usages such as HTTPS when using a local certificate, you can

$ curl-e Localcert.pem Https://remote_server

For example, you can also use curl to check the dictionary through the DICT Protocol ~

$ Curl Dict://dict.org/d:computer

Linux Curl (reproduced)