PHP crawler link pool and link scheduling how to write?

Link Pool function: 1, storage link, 2, to link to weight, 3, set priority on the link.
The practical solutions are: 1, save in database, 2, redis;3, Memory set, 4, queue.

How does the code for the link pool and crawl schedule write?

Reply content:

Link Pool function: 1, storage link, 2, to link to weight, 3, set priority on the link.
The practical solutions are: 1, save in database, 2, redis;3, Memory set, 4, queue.

How does the code for the link pool and crawl schedule write?

All the links to be crawled are fetched first, then the fetch action of each link is put into the queue, it is recommended to use Beanstalk, and finally the queue to perform these actions.

