Description of the five statuses in nutch readdb-Stats

After successful capturing, run bin/nutch readdb data/crawldb-Stats to view the captured statistics:

 

Total urls: 1843
Retry 0: 1838
Retry 1: 5
Min score: 0.0
AVG score: 5.20.936e-4
Max scores: 1.0
Status 1 (db_unfetched): 1748
Status 2 (db_fetched): 63
Status 3 (db_gone): 1
Status 4 (db_redir_temp): 29
Status 5 (db_redir_perm): 2
Crawldb statistics: Done

 

Meaning of five states: 1 is the URL that has not been requested, 2 is the URL that has been captured successfully (corresponding to status 200), 3 corresponds to 404, 4 corresponds to 302, 5 corresponds to 301.