Go to working with httpwebrequest and httpwebresponse in ASP. NET

From: http://www.worldofasp.net/tut/WebRequest/Working_with_HttpWebRequest_and_HttpWebResponse_in_ASPNET_114.aspx

 

Introduction

I will explain about the usageHttpwebrequestAndHttpwebresponseIn this article. as you all probably know or heard about this class before. httpwebrequest and httpwebresponse class is inside the system. net namespace, and this two classes is designed to communicate by using the HTTP protocol

You can use this two classes to make requests to other web pages via HTTP and parse the resulting text to extract data. This is what we know as screen scraping.

In ASP world, you normally need to rely on third party components called asptear to grab the contents from other site. But now with the helpHttpwebrequestAndHttpwebresponse, You can do that easily without have to invoke third party components.

Using httpwebrequest and httpwebresponse

In the code below, I provide very basic sample code on how to use httpwebrequest and httpwebresponse. in the first example I will list out the code on how to do screen scraping and the second example wocould be doing httppost data to another website

1. Sample Code on grabbing contents (screen scraping)

C #

protected void Page_Load(object sender,EventArgs e) {Uri uri = new Uri("http://www.microsoft.com/default.aspx");if(uri.Scheme = Uri.UriSchemeHttp) {HttpWebRequest request = HttpWebRequest.Create(uri);request.Method = WebRequestMethods.Http.Get;HttpWebResponse response = request.GetResponse();StreamReader reader = new StreamReader(response.GetResponseStream());string  tmp = reader.ReadToEnd();response.Close();Response.Write(tmp);}}

VB. NET

Protected Sub Page_Load(ByVal sender as Object,ByVal e as System.EventArgs)Dim uri as New Uri("http://www.microsoft.com/default.aspx");If(uri.Scheme == uri.UriSchemeHttp) ThenDim request as HttpWebRequest = HttpWebRequest.Create(uri)request.Method = WebRequestMethods.Http.GetDim response As HttpWebResponse = request.GetResponse()Dim reader As New StreamReader(response.GetResponseStream())Dim tmp As String = reader.ReadToEnd()response.Close()Response.Write(tmp)End IfEnd Sub

If you try to run the code, you can see that all the HTML code from Microsoft site has been grabbed and display on your local web server.

2. Sample Code on How to post data to remote web page using httpwebrequest

C #

protected void Page_Load(object sender,EventArgs e) {Uri uri = new Uri("http://www.amazon.com/exec/obidos/search-handle-form/102-5194535-6807312");string data = "field-keywords=ASP.NET 2.0";if (uri.Scheme == Uri.UriSchemeHttp){HttpWebRequest request = (HttpWebRequest)HttpWebRequest.Create(uri);request.Method = WebRequestMethods.Http.Post;request.ContentLength = data.Length;request.ContentType = "application/x-www-form-urlencoded";StreamWriter writer = new StreamWriter(request.GetRequestStream());writer.Write(data);writer.Close();HttpWebResponse response = (HttpWebResponse)request.GetResponse();StreamReader reader = new StreamReader(response.GetResponseStream());string tmp = reader.ReadToEnd();response.Close();Response.Write(tmp);}}

VB. NET

Protected Sub Page_Load(ByVal sender As Object, ByVal e As System.EventArgs) Handles Me.LoadDim uri As New Uri("http://www.amazon.com/exec/obidos/search-handle-form/102-5194535-6807312")Dim data As String = "field-keywords=ASP.NET 2.0"If uri.Scheme = uri.UriSchemeHttp ThenDim request As HttpWebRequest = HttpWebRequest.Create(uri)request.Method = WebRequestMethods.Http.Postrequest.ContentLength = data.Lengthrequest.ContentType = "application/x-www-form-urlencoded"Dim writer As New StreamWriter(request.GetRequestStream)writer.Write(data)writer.Close()Dim oResponse As HttpWebResponse = request.GetResponse()Dim reader As New StreamReader(oResponse.GetResponseStream())Dim tmp As String = reader.ReadToEnd()oResponse.Close()Response.Write(tmp)End IfEnd Sub

Conclusion

Based on the sample code above, you can see that it is quite simple to do http post and http get to remote website by using two built in class httpwebrequest and httpwebresponse. there is another set of classes calledFtpwebrequestAnd ftpwebresponse that allow you to do FTP post and get to remote FTP server.