A more accurate way to get Google index volume

Recently served as a Third-party SEO consultant for a large and medium-sized English website, for some reason, the URL of some part of the website needs to change, appearing hundreds of thousands of page level 301 and 404. How can I count the new page to be indexed by Google? In fact, you can use the Google Administrator tool, you can count the new pages have been indexed by Google, and can also be more accurate to get the overall site in Google's index volume.

Take my blog as an example, directly site my blog to find 486 results, and my blog currently only 72 articles, plus the classification of the page is also a good difference hundreds of. The reason is the early time to replace the host, their big head ha forgot to upload robots.txt, resulting in some duplicate content page also included, and later uploaded the robots.txt. Now Google "Site:yihuiblog.com" will appear as follows, only the site has no content (after a period of time will be deleted).

Site will be a lot of problems, resulting in search engine index some webmaster do not want to index the page, including common duplicate content page, infinite loop page (usually we also try to find these links to screen out and to Google Administrator tools to delete), large and medium-sized sites are more common. But do these index data have a big effect on SEO analysis? not even 0.

In fact, you can get the "real" data in the Google Admin Tool sitemap module, and this "real" depends on which pages you want to be indexed by Google. Now I want to know how many articles and classification pages I blog are indexed, first I make two sitemap files, one contains all the article address (URL), one contains all the category address, and then the Admin tool submits Sitemap address.

Google Administrator tool background direct submission than robots.txt write map address better, on the one hand more flexible, on the one hand can prevent competitors to obtain site data for research.

Because of the demo, the pursuit of simplicity, here I only produced a text map file, the mainstream search engine support RSS, Atom, XML and text, and many other formats of the map file, Google support a site map file contains up to 50,000 URLs, compressed before the volume must not exceed 50MB.

The figure above shows that Google has indexed 72 article pages and 22 category pages for a gray blog. According to the need to split the site map file, you can easily get the index data you want, and can submit overlapping URLs, such as at the same time to submit the website of the latest updated product page address and a classification of the product page address (there are overlapping URLs). The collected data can be targeted for optimization. For example, the optimization of long-term not indexed pages, such as Google spiders next crawl after the index, you can also with the same period of other SEO data fusion, get more to help the SEO data. In fact, Google in the site has been clear Google Administrator tool this function, but many people do not further use.

Using a good Google Administrator tool, you can draw away more useful data for SEO, and then slowly explore. The Bing Administrator tool also has a lot of useful data, so don't miss it.

Original address: http://yihuiblog.com/a/299.html