SharePoint Search crawls third-party web site configuration

Introduction: SharePoint Search is really powerful, and recently used SharePoint Search third party crawl, feeling very large, and online data did not find too many similar, on the small record, share to everyone.

First of all, I wrote a net page, which reads all the content I need, acts as a data source for SharePoint crawls, crawls the page as follows:

Then, open SharePoint Central Administration, search settings, new content source crawl, crawl http://moss:9000, as shown below. Crawl settings can be set according to their own needs, such as to crawl the depth of the Web page, you can set up, my crawl, just crawl the link below the page, so the depth is set to 1; Set to complete, do not crawl first, you need to set crawl rules.

See more highlights of this column: http://www.bianceng.cnhttp://www.bianceng.cn/web/sharepoint/

To set crawl rules:

Open the crawl rule, set the path, my path is 9000 ports under all the pages, so set to http://moss:9000/*, of course, your rules should be set according to need, you can exclude these paths, you can also include these paths, and, if there are any results of crawling, Can be ruled out here.

In particular, the links on my page contain the "?" Question mark, so check the complex URL to crawl, the following designated authentication, you can choose to authenticate the account, if you need form to authenticate the Web page, you can set the specified other content access account "Special: If the login requires authentication code, SharePoint is unable to crawl." After you set up the crawl rules, click OK to save, and then you can completely crawl the crawl content source.