A distributed web crawler system that contains the indexes that clients and servers can use to maintain web pages.
Grub C # Client 1.0 Release Notes:
The stable version of Grub Next Generation Database tool is available for download. Changes since last release (0.9):
-Fixed bug with crash creating database backup
-Added decoupled URL ' s cleanup (from session ID, etc)
-Added updating progress information only if is needed
-Added deleting file after compression
-Some code optimization
Can download source code and zip compressed server from project page.
Grub Next Generation Database tool is console program for manipulate database with URL ' s and SOLR (CREATE DATABASE, adding/ Deleting URL ' s, optimize DATABASE/SOLR, generate new Workunits) written in C # (Mono).
Download Address:
Version Downloads Date 1.0-windows Download (5.32 MB) 2011-may-26 1.0-unix Download (286.65 KB) 2011-may-26 1.0-tar.gz downl Oad (463.38 KB) 2011-may-26 1.0-linux Download (1.54 MB) 2011-may-26 1.0-freebsd (Download MB) 1.95