Popular Science knowledge: deep NET and Dark Net __ Network data collection

You may have heard of terms such as deep web, Dark Network (dark web) or hidden network (hidden web), especially in the most recent media. What do they mean?

Deep Net is a part of the network, and the shallow network (surface Web) opposition. Shallow web is the Internet search engine can catch that part of the network. According to incomplete statistics, the Internet in fact about 90% of the network is deep net. Because Google can not do such things as form submission, and can not find those who do not directly linked to the top-level domain name of the Web page, or because there is robots.txt prohibited and can not view the site, so the number of shallow net relatively deep net or relatively few.

Dark nets, also known as darknet or Dark Internet, are entirely another "monster". They are also based on existing networks, but using the Tor client, with a new protocol running over HTTP, provides a secure tunnel for information exchange. This kind of dark web page can also be collected, just as you collect other sites.

Unlike dark nets, deep nets are relatively easy to collect. In fact, many of the tools crawled are gathering deep web information that Google Crawler robots can't get.