Python learning----deep and dark nets

The deep Web is part of the network, and is opposed to a shallow network (surface Web). Shallow web is the Internet search engine can catch

To that part of the network. Incomplete statistics, the Internet in fact about 90% of the network is a deep network. Because Google does not

You can do things like form submissions, and you can't find those pages that aren't directly linked to the top-level domain, or because

In order to have robots.txt forbidden to view the website, so the number of shallow nets relatively deep net or relatively few.

The dark web, also known as the darknet or Dark Internet, is a completely different "monster". They are also based on existing

Network, but using the Tor client, with a new protocol running over HTTP, provides a

Secure tunnel for information exchange. This kind of dark web page can also be collected, as you collect other sites, not

This content is beyond the scope of this book.

Unlike dark nets, deep nets are relatively easy to collect.

Python learning----deep and dark nets