As seo practitioners, we must have a certain understanding of search engines. maybe many people know Google and Baidu spider. Today, let's talk about the Google bots you know.
As seo practitioners, we must have a certain understanding of search engines. maybe many people know Google and Baidu spider. Today, let's talk about the Google bots you know.
Google bot is generally called a Google robot or Google detector.
Google "dispatches" different Googlebots to retrieve webpage content. It mainly includes:
Googlebot: captures text in a webpage. The obtained content is stored in the databases of Google web search and news search. We generally talk about Google robots.
Googlebot-Mobile: captures text content on a webpage for Google Mobile search.
Googlebot-Image: captures the Image content on the webpage and saves it to the Google Image search database.
Mediapartners-Google: captures text content on a webpage for Google Adsense analysis keywords. Only webpages with Google Adsense are crawled by the Mediapartners-Google detector.
Adsbot-Google: captures the text content on a webpage for Google AdWords reference. Only the target webpage of Google AdWords will be crawled by the Adsbot-Google detector.
Googlebot and Mediapartners-Google are very diligent robots. if they affect your server's endurance, you can use the robots.txt file to stop it.