How does the collection system implement a key acquisition?

To design and implement a collection system, how do you enter a list link address, and then automatically parse the article list and article content? Is there any good idea?

Reply content:

To design and implement a collection system, how do you enter a list link address, and then automatically parse the article list and article content? Is there any good idea?

See what you're collecting on the website, and then what language are you going to use?

Bash shell is relatively simple

It can be implemented using Python and writing crawlers.

Look at your tag is PHP, then the default you have to use PHP to do it.
Regular collectors are given a list of link addresses, and then get the content of the connection, followed by the regular, parse the beginning of the list of the end of the section.
Next, the contents of the list are cut, cut with a specific content, get a block of individual data, a regular match URL, etc.
Go to the details page to get what you want, store

It's not hard to do, but it takes patience.

