Java Crawl Web page data sample _java

The following examples illustrate:

Crawl Baidu Homepage Content:

Copy Code code as follows:

URL url = new URL ("http://www.baidu.com");
HttpURLConnection urlcon= (httpurlconnection) url.openconnection ();
Urlcon.setconnecttimeout (50000);
Urlcon.setreadtimeout (300000);
DataInputStream FIn;
byte[] content = new Byte[max_file_size];
FIn = new DataInputStream (Urlcon.getinputstream ());
int size = 0,f_size = 0;
while (size = Fin.read (content,f_size,2048)) > 0) {
F_size + = size;
}

In the code we will be the content of Baidu's home page stored in a byte array, of course, we have IO stream can also be stored in the file.