Website data collection Software Netspider

Netspider Website Data acquisition software is an open source software based on the. NET platform.
Software part of the function is the basic Soukey software development. This version was developed using vs2010+.net3.5.
Netspider Harvesting currently offers the following main features:

1. Multi-task multithreading data acquisition, support post mode (pending);
2.?? to capture Ajax pages;
3. Support cookies, support manual login to collect data;
4. Support acquisition transactions;
5. Support Data automatic and manual export, export format: text, Excel, Access, MSSQL, MySQL, etc.;
6. Support to publish data online;
7. Support Navigation URL collection, navigation depth is not limited;
8. Support auto-paging;
9. Support file download, can collect pictures, flash and other files;
10. Support the processing of data acquisition results, including replacement, prefix suffix, interception and other operations, support the regular;
11. The collection URL definition not only supports the basic parameter definition, but also can add the dictionary data as the URL parameter for data collection;
12. Support multi-instance operation of a task;
13. Provide scheduled tasks, scheduled Tasks support Netspider acquisition tasks, external executable tasks, database stored procedure tasks (still in development);
14. The scheduled task execution cycle supports daily, weekly and custom run intervals; The minimum unit is half an hour;
15. Support task trigger to automatically trigger other tasks (including executables or stored procedures) when the acquisition task is complete.
16. Perfect log function: System log, task execution log, error log and so on;
17. The system provides a mini browser to capture cookies or post data;

The Netspider collector does not limit whether you are commercially available, the source is completely open,


=================== The following is the update content ===================================


1. Netspider opened on October 1, 2014

Website data collection Software Netspider