1. A/B testing some terms related to grayscale publishing Test Origin 1.1 barrels test (bucket testing): This is not a clear definition, but it is usually a comparative test abroad for testing the pool for leaks. A bucket of water will be placed in the swimming pool, marked with internal and external water level, placed after a period of time, if the external water level significantly decreased (more than xxx inches), it is proof that the pool leaking. This is not directly related to software testing, but he is a contrast test between two scenarios to identify defects. 1.2 Multivariate testing (multivariate testing): This is a term used in marketing, often used in complex environments with multiple variables, to compare the effectiveness of marketing scenarios. Evolutionary 1.3 A/B testing (A/B testing): The definition of Wikipedia, "is a test method used in web design (often referred to as user experience) to differentiate between two web designs that support the effect of maximizing revenue targets (such as CTR)." It is mainly used to compare the pros and cons of two designs. Bucket test, multivariable test (multivariate testing) is a variant of A/b test, as it may involve comparisons of multiple scenarios. A/B testing is also used for comparison of marketing channels, which is consistent with the definition, because a Web page is a marketing channel. 1.4 Grayscale Delivery: "Grayscale publishing is a way to publish a smooth transition between black and white." AB Test is a grayscale publishing method, let a user continue with a, some users start with B, if the user has no objection to B, then gradually expand the scope of all users to move to the top. Gray-scale publishing can ensure the stability of the overall system, in the initial gray level can be found, adjust the problem to ensure its impact. ”
2, A/B testing and grayscale publishing and traditional testing of different points 2.1 can have a number of ready-made products to the real test (bucket test) 2.2 A/B testing is a way to support multivariate testing 2.3 A/B testing system, is a grayscale publishing a way to achieve this end, Testing and operations have been integrated into one process.
3, A/test and gray-scale release of the theoretical support products are multidimensional, design experience, interactive experience, system quality, operational support, etc., the purpose of testing is to the final delivery of the system, a set of all aspects of the system is good enough, rather than the document defined on the system, the system needs to evolve. The challenge of testing runs through the design of the product to the coding to the final operating process, and ultimately to the improvement of the product, the cycle. In line with the essence of Internet thinking agility. 4, A/B testing and the use of gray-scale publishing 3.1 recommended comparison of different algorithms between the system, the comparison of different variables 3.2 design scheme of the comparison of the different 3.3 design adjustment, scheme adjustment 3.4 fault control
If your system needs to optimize some areas of your own that you cannot predict and control. Try A/b test to help control future risks
Data is an important basis for optimizing your system, and where you want to optimize it, you accumulate data in what areas.
A/B testing and Grayscale publishing
