C # Crawler Framework Implementation overview

Directory:

1. C # Crawler Framework Implementation overview
2. C # Crawler Framework implementation Process _ Crawler structure/principle
3. C # Crawler Framework implementation Process _ all kinds of development
4. C # Crawler Framework implementation Process _ problems encountered
5. C # Crawler Framework Implementation PostScript

Development Purpose: Write this program mainly to find a job. Because no project on the resume to eat a big loss, word ..., can only make something to prove that they can do things.

Customization Required:

• Patternlist Match Definition
• Define the result output mode: Local SQL Server spider database, or terminal
• Seed Bank

Need:

• Development uses the Open source class: Csquery parsing html, so patternlist match writing specification to conform to csquery, in fact, the basic and CSS selectors almost
• Using Visual Studio Update2

C # Crawler Framework Implementation overview