How to optimize a list of massive data and frequent updates

Source: Internet
Author: User
How do you optimize a list of massive data and frequent updates?
Now the website data is very many, and update frequently, such the station Content List page How to optimize? At the moment we are generating static data, which can be more and more, so that the time consumed by each generation is terrible. Does anyone know how the list of those big websites is handled? Kneeling solution ....

------Solution--------------------
Unexpectedly is the big website must do some big website the practice. Like hardware follow up and so on
Update frequent things will not be suitable for static, why update frequent things to do static it?
If it's a structural problem, then you have to think about the re-structuring.

How to optimize can be introduced into memcache and other servers to share data in a way to handle.
Or dynamically read part of the change.
------Solution--------------------
Because the updates are frequent, the list page simply needs to change the last few pages.
For example, 50 per page, then the original 1th page after the new 50 has become the 2nd page, and the content is the same as the original first page

It is also important to note the fact that very few people will flip 10 or more times along the paging bar. and use the search function more
------Solution--------------------
The update frequently does not fit in with static. The first minute just generated the next minute to update again, it is not ...
------Solution--------------------
discuss

The update frequently does not fit in with static. The first minute just generated the next minute to update again, it is not ...

------Solution--------------------
Statistics in the end where people look for more, such as the first 100 electronic goods, you can make these 100 static pages, multi-user search function, to avoid the user invalid and wasteful operation, the database if the slow, in addition to algorithm statements, index optimization, but also the data can be divided into tables, for example, Put the hot electronic goods from the commodity, can alleviate some of the pressure, Big website architecture is the core
------Solution--------------------
It still depends on how frequently his frequent updates are going to be done. Using caching techniques is a must. There are many ways to do this, and the architecture may need to be redesigned ...
When it comes to high traffic and concurrency, there is a need for constant follow-up on the hardware. There is no actual environment, but also can be generalized to you pull a pull.
------Solution--------------------
discuss

It still depends on how frequently his frequent updates are going to be done. Using caching techniques is a must. There are many ways to do this, and the architecture may need to be redesigned ...
When it comes to high traffic and concurrency, there is a need for constant follow-up on the hardware. There is no actual environment, but also can be generalized to you pull a pull.

------Solution--------------------
I'm here to study.

You can't change the database?
------Solution--------------------
This has to be studied.
------Solution--------------------
discuss

Reference:

Because the updates are frequent, the list page simply needs to change the last few pages.
For example, 50 per page, then the original 1th page after the new 50 has become the 2nd page, and the content is the same as the original first page

It is also important to note the fact that very few people will flip 10 or more times along the paging bar. and use the search function more

Update every day has hundreds of appearance, nagging boss, according to you say, follow the page adopt dynamic?

------Solution--------------------
discuss

Reference:

Because the updates are frequent, the list page simply needs to change the last few pages.
For example, 50 per page, then the original 1th page after the new 50 has become the 2nd page, and the content is the same as the original first page

It is also important to note the fact that very few people will flip 10 or more times along the paging bar. and use the search function more

Update every day has hundreds of appearance, nagging boss, according to you say, follow the page adopt dynamic?

------Solution--------------------
Static is not omnipotent ... Should not be static at all, the key place different cache measures can be

In order to reduce the pressure, this measure actually become pressure, not funny?
------Solution--------------------
It is good to use a single page user to trigger the way to generate static, the advantage of doing this is to generate one-pages in the background, for infrequently accessed pages do not often waste resources due to unnecessary generation, and often accessed pages are frequently updated generated, the principle is:
If a page last generated a static time is 11 points, when the 12 point when there is user access, then only need to invoke the JS way to trigger a rebuild the page is good, when the next visitor to actually see is the 12-point update page, so that each update only one page, Does not take too long, and JS triggers a background build and does not affect access to the foreground.
If you are concerned about frequent updates, you can use PHP to get the last update time of the page that needs updating, and if the interval is now less than half an hour, then ignore the update, if it is more than half an hour, then regenerate the new static page.

I used to do a large-scale portal is used in this way to do Automatic updates, do not need to manually generate background, not only waste manpower and the effect is also great.
------Solution--------------------
discuss

Static is not omnipotent ... Should not be static at all, the key place different cache measures can be

In order to reduce the pressure, this measure actually become pressure, not funny?

------Solution--------------------
Timer service, automatically generate pages, then push the past.
------Solution--------------------
discuss
Reference:

The update frequently does not fit in with static. The first minute just generated the next minute to update again, it is not ...

Or!
Suppose there are 100 people visiting every minute
Generate a static page once the operation is done
and the dynamic need to operate 100 times

Moreover, updating a list page is only done when there is data submitted.

------Solution--------------------
  • Related Article

    Contact Us

    The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

    If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

    A Free Trial That Lets You Build Big!

    Start building with 50+ products and up to 12 months usage for Elastic Compute Service

    • Sales Support

      1 on 1 presale consultation

    • After-Sales Support

      24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.