Cache database redis, storage URL

Rtfm
Http://www.cnblogs.com/stephen-liu74/archive/2012/03/14/2349815.html


Http://blog.csdn.net/zx13525079024/article/details/8124790
Http://www.cnblogs.com/daizhj/archive/2011/02/17/1956860.html
Http://www.cnblogs.com/daizhj/archive/2011/02/17/1956860.html

Http://blog.chinaunix.net/uid-23633820-id-2393559.html redis backup and recovery

Http://wenku.baidu.com/view/2918b8186edb6f1aff001f31.html C # redis things

Rtfm:
Http://blog.csdn.net/Java2King/article/details/5754476

Yitao crawler Architecture
Http://www.biaodianfu.com/mplementation-of-targeted-crawling-system.html

Sqllite
Http://zetcode.com/db/sqlitecsharp/
Https://code.google.com/p/csharp-sqlite/

Redis deduplication:
Http://jandyu.diandian.com/post/2012-03-15/16145594

Http://www.searchtb.com/2011/07/%E5%BF% AB %E9%80%9F%E6%9E%84%E5%BB%BA%E5% AE %9E%E6%97%B6%E6%8A%93%E5%8F%96%E9%9B%86%E7%BE%A4.html


Does WebKit be used to load dynamic webpages and then process the content of webpages?

Http://www.189works.com/article-41593-1.html