User-Agent Analysis

I recommend my IIS log analyzer!

What is User-Agent?

User-Agent: record the browser from which the request comes.

User-Agent analyze website http://www.useragentstring.com/

You can know the visitor information by parsing the User-Agent.

The IIS log of the server for one day is intercepted for analysis!

Robot search Robot

Search engines like Google and Baidu all have automatic crawlers.ProgramThe web page information is continuously crawled on the Internet. To create their search indexes!

The following is the crawler User-Agent: (in alphabetical order)

Baiduspider + (+ http://www.baidu.com/search/spider.htm)Baidu webpage

Gigabot/3.0 + (http://www.gigablast.com/spider.html)Foreign green search

Googlebot-image/1.0Google Image Search

Drawing weisymantecspider/1.0 + DSE-support@huaweisymantec.com + (compatible; + MSIE + 7.0; + http://www.huaweisymantec.com/en/IRL/spider)

Huawei Symantec

Larbin + (larbin@unspecified.mail)Open-source network spider

Mlbot + (www.metadatalabs.com/mlbot)Unknown

Mozilla/5.0 + (compatible; + 008/0. 83; + http://www.80legs.com/webcrawler.html;) + Gecko/2008032620Custom crawlers outside China

Mozilla/5.0 + (compatible; + bingbot/2.0; ++ http://www.bing.com/bingbot.htm)Microsoft Bing

Mozilla/5.0 + (compatible; + crawler/3.0.0 ++ http://www.notconfigured.com /)Unknown

Mozilla/5.0 + (compatible; + dotbot/1.1; + http://www.dotnetdotcom.org/,+crawler@dotnetdotcom.org)Foreign Internet analysis statistics

Mozilla/5.0 + (compatible; + googlebot/2.1; ++ http://www.google.com/bot.html)Google

Mozilla/5.0 + (compatible; + mj12bot/v1.3.3; + http://www.majestic12.co.uk/bot.php? +)UK

Mozilla/5.0 + (compatible; + search17bot/1.1; + http://www.search17.com/bot.php)Unknown

Mozilla/5.0 + (compatible; + Yahoo! + Slurp; + http://help.yahoo.com/help/us/ysearch/slurp)Yahoo

Mozilla/5.0 + (compatible; + Yahoo! + Slurp + China; + http://misc.yahoo.com.cn/help.html)Yahoo

Mozilla/5.0 + (compatible; + yandexbot/3.0; ++ http://yandex.com/bots)Russian Search Engine

Mozilla/5.0 + (compatible; + yandexbot/3.0; + mirrordetector; ++ http://yandex.com/bots)Russian Search Engine

Mozilla/5.0 + (compatible; + youdaobot/1.0; + http://www.youdao.com/help/webmaster/spider/;+)Youdao

Mozilla/5.0 + (compatible; yodaobot-image/1.0; http://www.youdao.com/help/webmaster/spider /;)Youdao Image

Msnbot/2.0b + (+ http://search.msn.com/msnbot.htm )._MSN Search

Msnbot-Media/1.1 + (+ http://search.msn.com/msnbot.htm)MSN Search

Panscient.comOverseas vertical search

Sogou + PIC + spider/3.0 (+ http://www.sogou.com/docs/help/webmasters.htm#07)Sogou Images

Sogou-test-spider/4.0 + (compatible; + MSIE + 5.5; + windows + 98)Unknown

Sosoimagespider + (+ http://help.soso.com/soso-image-spider.htm)Search for images

Sosospider + (+ http://help.soso.com/webspider.htm)Sousearch

Yeti/1.0 + (NHN + Corp.; + http://help.naver.com/robots)Korean search

Zawc/Nutch-1.0 + (http://www.zawc.com)Prepare to transfer sweat

Docomo/ 2.0 + p900i (C100; TB; w24h11) (compatible; + Ichiro/mobile + goo; + http://help.goo.ne.jp/door/crawler.html)Search for Japan

Mozilla/4.0 + (compatible; + http://search.thunderstone.com/texis/websearch/about.html)Foreign

Mozilla/5.0 + (windows; + U; + windows + nt + 5.1; + en-US) + speedy + spider + (http://www.entireweb.com/about/search_tech/speedy_spider)

Analysis:

There are so many robot visits! Note that User-Agent can be forged. Many search crawlers are mentioned on the description page. However, you can analyze the IP address to identify it!

Other User-Agent

+ (^_^)Khan! I don't know what it is.

Applewebkit/532.7 + (khtml, + like + gecko) + Chrome/4.0.271.1 + Safari/532.7 + tencenttraveler/5.0 + qqbrowser/5.0.6587.400 + (WebKit)

Brew-applet/0x20068888 + (brew/3.1.5.20; + DeviceID: + 110006; + LANG: + zhcn) + ucweb-squid

Hd2_t8585 + Mozilla/4.0 + (compatible; + MSIE + 4.01; + windows + Ce; + PPC)/ucweb7.4.0.57/31/999

Hd_mini_t5555 + Mozilla/4.0 + (compatible; + MSIE + 4.01; + windows + Ce; + PPC)/ucweb7.4.1.61/31/999

Htc_hd2_t8585 + Mozilla/4.0 + (compatible; + MSIE + 4.01; + windows + Ce; + PPC)/ucweb7.4.1.61/31/999

HUAWEI + c5110 + Java/hwja/1.0 + profile/MIDP-2.0 + configuration/CLDC-1.1 + untrusted/1.0

J2EE

J2EE/ucweb7.3.1.56/139/800

Jakarta + commons-httpclient/3.1

Java/1.6.0 _ 10

LG-KG70 + mic/1.1.14 + MIDP-2.0/CLDC-1.1 + untrusted/1.0

Maui_wap_browser

MOT-EM330/0.0.96 + untrusted/1.0

Mcy + 6.0

Microsoft-Atl-native/1, 9.00

Mozilla/4.0.

Mozilla/4.0 + (compatible; + MSIE + 4.01; + windows + 95)Ie4 and Win95 are still available

Mozilla/4.0 + (compatible; + MSIE + 4.01; + windows + 98)

Mozilla/4.0 + (compatible; + MSIE + 4.01; + windows + Ce; + PPC)/ucweb7.4.0.57/31/800

Mozilla/4.0 + (compatible; + MSIE + 6.0 ;)

Mozilla/4.0 + (compatible; + MSIE + 7.0; + windows + nt + 5.1; + 360se)

Mozilla/4.0 + (compatible; + MSIE + 8.0; + windows + nt + 5.1; + Trident/4.0)

Mozilla/5.0 + (Linux; + U; + Android + 2.1; + zh-CN; + T2 + build/erd79) + applewebkit/530.17 + (khtml, + like + gecko) + version/4.0 + mobile + Safari/530.17

Mozilla/5.0 + (Macintosh; + U; + intel + Mac + OS + x + 10_6; + zh-CN) + applewebkit/531.9 + (khtml, + like + gecko) + version/4.0.3 + Safari/531.9

Mozilla/5.0 + (windows; + U; + windows + nt + 5.1; + en-US) + applewebkit/534.6 + (khtml, + like + gecko) + Chrome/6.0.493.0 + Safari/534.6

Mozilla/5.0 + (iPhone; + U; + CPU + iPhone + OS + 4_1 + like + Mac + OS + X; + zh-CN) + applewebkit/532.9 + (khtml, + like + gecko) + mobile/8b117

Nokia3250/ucweb7.1.0.42/28/800UC on mobile phone

Opera/9.80 + (Windows + nt + 5.1; + U; + zh-CN) + presto/2.6.30 + version/10.60

Palm680/RC1 + (iPhone; + U; + CPU + iPhone + OS + 2_2_1 + like + Mac + OS + X; + zh-CN)/ucweb7.4.1.68/41/997

Python-urllib/1.17

Sonyericssonu100i/r1ba + profile/MIDP-2.1 + configuration/CLDC-1.1

Tencenttraveler + 4.0

Ucweb7.4.0.57/28/999

Untrusted/1.0

Unknown/gobrowser/1.6.0.70

Wget/1.10.2 + (Red + hat + modified)

Wget/1.9 + CVS-stable + (Red + hat + modified)

ZTE-me/mobile

AboutthedomainWhat

Kuanguang + Java/1.6.0 _ 18

Libwww.perl/5.836

 

Analysis:

If you see the above User-Agent, you will find the User-Agent on your mobile phone confused! The User-Agent also contains a large amount of software and system information!

Why is no one giving a standard! Various mobile Internet platforms! In the end, we will only suffer from programmers!