GooglebotWe are generally referred to as Google robots or Google probes.
Google "Dispatches" different googlebots to retrieve webpage content. It mainly includes:
- Googlebot: captures text in a webpage. The obtained content is stored in the databases of Google Web search and news search. We generally talk about Google robots.
- Googlebot-Mobile: captures text content on a webpage for Google mobile search.
- Googlebot-image: captures the image content on the webpage and saves it to the Google image search database.
- Mediapartners-Google: captures text content on a webpage for Google Adsense analysis keywords. Only webpages with Google Adsense are crawled by the mediapartners-Google detector.
- Adsbot-Google: captures the text content on a webpage for Google adwords reference. Only the target webpage of Google adwords will be crawled by the adsbot-Google detector.
Googlebot and mediapartners-Google are very diligent robots. If they affect your server's endurance, you can use the robots.txt file to stop it.
From: http://www.seowhy.com/12_105_zh.html
