Some small problems with curl

How to crawl the latest data with curl?
For example, I crawled all the information of a site, and then the site was updated, how can I crawl the updated few, and not repeat the crawl.

Reply to discussion (solution)

The fetch is then saved to the local database. Then find out what the rules are for the latest few. If it can be distinguished, the previous local database has been modified. It is really not the difference, all the crawl to save once, if saved successfully, clean up the previous data can be.

Only if you see it, do you know if it's new?

Curl with attribute Curlopt_writefunction
The callback function can be used to determine whether the crawl can end prematurely

Oh, take the database of the largest ID, and then get the ID of the message, and then the page gets the ID than the database out of the larger is the latest.
But this is not all the data to be judged once, the efficiency is not very low?

I understand that these times can be neglected, knot stickers, thanks

