Practical experience in different places (two live) _ Yun-Wei

Many live in different places (live) is the recent industry discussion more topics, especially in the past a while to pay the treasure room of optical fiber failure and Ctrip database lost, more aroused the technical staff of the disaster disaster-tolerant consideration.


And many live in different places than the disaster disaster more advanced level, because disaster tolerance is only a cold standby concept, and many live in different places is that there are two or more can be at the same time external service nodes, any one point hung, can also quickly switch to other nodes external services, the data between the nodes to achieve quasi real-time synchronization.


Read a lot of technical sharing on the Internet, summed up the following practical experience:


1 if the volume of business is not large, there is no need to do a lot of live in different places, because many live needs of the operation and maintenance of resources costs, development costs are very high;


2 pay attention to the delay of the machine room, the delay may reach more than 100ms, if the business needs many times across the machine room request application, the problem of delay will be completely enlarged;


3 cross-room of the special line very large probability will be problematic, to do a good job or program level fault tolerance;


4 can not rely on MySQL double write, must have to adapt to their own business of the cross-room message synchronization program;


5 MySQL or other storage data synchronization problem, in the case of high latency and poor network quality, consider how to ensure the quality of synchronization;


6 core business and secondary business needs to divide and conquer, more than a live business form the simpler the better, or even only to do the core business;


7 off-site monitoring, deployment, testing and other processes to keep up;


8 in the case of business permit, consider the user partition, especially the game, mailbox business relatively easy to do;


9 control the size of the message body across the room, the smaller the better;


10 Consider the use of Docker and other container virtualization technology, improve the dynamic scheduling capability;