Young kingdoms with what dare two-end synchronous public test, centralized package volume type of launch?

Since the "Juvenile Kingdoms" on the 10th day of the App store climbed the top three, the public test 20 days of broken water, has been asked many times, less than three cast a lot of hard and wide, which channels effective, activities are how to do, and what measures have been taken to retain ... But a person has not asked, a week to throw away so much money afraid? What happens in the middle of the outage? How to ensure stable operation? ......

is the industry's impetuous lead to look at the surface of the problem, or the hand-travel issue has matured to do not need to think about these basic issues, the realm of the unknown. But in the public test only 20 days, "Juvenile kingdoms" alone with the domestic market can break through 100 million of the water today, has opened more than 300 groups of servers today, I recall the most is not the goal to achieve the surprise, but can not be relieved of the early morning of 12th a false alarm when the despair.


If you really want to sum up the experience of "juvenile kingdoms", I just want to say, stability is better than everything, to push the product to the S-class position, hard to fight the strength.


Teenager Kingdoms


with what dare double end synchronous test, centralized package volume type of delivery?


"Juvenile Kingdoms" before, there is no such large-scale focus on advertising hand tour. More than 20 TV stations, dozens of train lines and railway stations, almost all game media, hundreds of mobile applications, a number of video patches ... Concentrated in a day-long explosion, lasting two weeks of high density exposure. IOS, Android version of the synchronous test, nearly 50 Android App Store sync centralized optimal location recommended, even contains a number of open-screen advertising and application store system message push.


these exciting resources behind, which means that the first day estimated more than 400,000 of new users, to open almost 12 groups of servers, even if one hour downtime is hundreds of thousands of of the cost of advertising costs; if there is a major bug that requires the App store to resubmit the version update, then wait for the Apple audit for 3-7 days, Tens of millions of advertising costs all hit the water drift; if the Android version of compatibility issues, then dozens of channels of recommended resources immediately stop ...

Behind the
of such high risk, is two years three successful products of the lessons of precipitation, is dozens of of the user is not visible security function development, is hundreds of products on-line inspection, is a number of user testing and data validation, is an efficient SDK access and server Management program, is up to 1.5 months of crazy risk ......


Teenager Kingdoms


data to speak, why apply for such a high budget


"Juvenile Kingdoms" before making the public test plan, carried out 3 goals clear, rigorous test-oriented user testing, to fully tune the product, the final quality of the effective judgment: through the small range of users of the elite test, to verify the acceptance of the core play and the stability of the product operation; Verify and optimize the product play experience, ensure the retention, through the charge test, verify and tune the product numerical experience to ensure the commercialization of data. From the first elite test, we finalized the beta node for nearly 4 months.


in early January, the product after nearly 1 months of tuning, all aspects of operating data indicators have reached a level of standards, and the data is fairly stable. This kind of data performance, let us have full confidence-this product can be made, we only need to do a set of beautiful public testing solutions to test how high. At this time, we will confirm the public test schedule and initial market budget scale, and in order to maximize the promotion effect, to determine the iOS, Android synchronous big push strategy.


SUPERSDK, let 1 weeks access to nearly 50 channels to become a reality


to determine the joint test node, from the official test only 1 months time. We've decided that iOS and Android are in sync, which means that in 1 months we have to pick up dozens of channels of SDK.


at this time, through several product distribution accumulated SUPERSDK played a huge role. "Meng Hu Hu" era of access to an SDK to 3 days of memory, and to the "Juvenile Kingdoms", with integrated SUPERSDK, nearly 40 SDK connected only a week more time, but also support CPS subcontracting function.


SDK is connected, in order to ensure stability, we not only for each of the sub-package SDK features tested, but also on the focus of the sub-Andro with hundreds of models of the real machine test plus more models of cloud testing, external contract 0 failure.


Stability Test, 9 technical preparation Escort


once in a circle of friends sent a sentence: system, fitness, SDK, mixed clothing, since the update, CPS, IDFA ... To share the next few steps. The result is the most reply is: You can ask who first did not have every step of the ~


planted, will have countermeasures. The most important thing to say, altogether 9 items:


1 The front and back end code can be hot updated to fix bugs at any time


2 Multiple self-updating CDN line random switching reduces update interrupt


3) Multiple auto-update packages are merged automatically to avoid missing updated user-loaded resources


4 support a variety of mixed-suit mode, and can be flexible backstage configuration, to meet the different channels at home and abroad to open the service requirements


5 supports multi-uniform open cycle recommendations to disperse the influx of users to the pressure and ensure that each server is adequate


6 Automatic collection of client errors, at any time to detect the problem


7) GM Back-end resource configuration warning to avoid operation error


8 GM Background A large number of timing and replication release function, reduce operating workload, reduce error rate


9 Dozens of configurable activities, adjust server ecology at any time


is the early morning of number 12th, which is only 8 hours away from mass advertising, and we found a 100% reproducible flash bug, which is a bug caused by an SDK problem. Everyone knows that updating the SDK means an entire package update, which means a 3-7-day arraignment, and it's impossible to get rid of the ad bit that has been bought. When everyone is in despair, we bury the hot update mechanism and solve the problem. To do more than one technical preparation, it is possible to save lives at a critical moment.


arraignment, App Store one-time audit through behind the secret


almost every team that does iOS applications has encountered several times in the App Store arraignment, and each time it is called back, it means a week or more of revision and review cycle. And advertising, it is necessary to set the node in advance. Therefore, a large number of manufacturers in order to ensure safe delivery, even after the arraignment after the start of the resources, resulting in at least 1 months of blank waiting.


Tour Network to the App Store audit specifications with the history of product audit but the experience, made a perfect checklist, from the development of the version specification, server configuration, recharge configuration, advertising monitoring and so on to the operation of icon/screenshots/video Production requirements, ASO settings, copyright notices, etc. Before the arraignment, as long as the inspection and acceptance, you can circumvent more than 90% of the possible Apple will be called back problems.


"Juvenile Kingdoms" this strict according to the norms of the audit, the first time on the audit passed, saving a lot of time.


test, test, or test


The previous reference to the SDK test, in fact, three this time for the public test for 1.5 months of nearly crazy testing. For example, for the stress test, we not only do the robot simulation to test the game server hosting, even login, recharge, game embedded page access, etc., all involved in the platform service environment, have done a centralized concurrency test. Our slogan at that time was that anyone would hang any server down in any way, with a prize!


version reserved, be prepared


product Push, we have to reduce the version of the update to avoid the dau loss. But at the same time, we must ensure timely updates, in order to the game content by users before the end, give users a new pursuit. We can not predict the current content of the game is enough, users play the game's progress, always beyond the developer's imagination. What we can do is to prepare a piece of data before the public test is turned on, so that when a certain percentage of game users start to get bored, it will be immediately updated to maintain operational data stability and gain time for subsequent optimizations and new content.


In fact there are many, and then I am afraid this article will be written in a book, the above only for a start. In short, after all kinds of preparation, "juvenile kingdoms" to the public test that day, has everything, only owe guide quantity.


two weeks open nearly 200 groups of uniforms, 0 accidents, we have done


before the public test preparation, like before the Liangxiang preparation and combat training. But the real battlefield, is after the public test opened. User guidance, problem response, data assurance and follow-up direction of the clear, this is true to do after the service.


near-exaggerated team staffing


Maybe you've had a 30-person trip years ago, but you shouldn't have heard of 30-person-run hands. "Juvenile Kingdoms" the volume of the plan, has surpassed most of the end of the year, and we put the service and user experience to the first, so before the public test, almost all the staff, composed of a 30-person operation team.


30 people running, is there so many things to do?


The first month of 24 hours a day to deal with customer service reporting events, Baidu Bar games related issues must be back, while maintaining seven or eight channel forums, and to ensure the active activities of these communities; a home application store to optimize product description, small series recommended, support more than 1000 advertising materials per day, optimize channel guidance; The writing of news soft text The operation of the micro-credit public number, 10 to 500 people Q Group Maintenance, in addition, the user research, opinion finishing, 10 per day, the guide volume monitoring, open service configuration, dozens of open service activities at any time analysis and optimization, and update the weekly dozens of cycle activities; version of the optimization case, data analysis report ...


30 people, day and night two shifts, busy to fly. And through the concentration of human resources, greatly protect the "juvenile kingdoms" propaganda effect, service quality, greatly improve the user's satisfaction.


almost paranoid open the service data insist


from the time of the page tour, open the service is the game operation's core rhythm control link. The number of guide, the server can not load, resulting in the loss of the card, the guidance is less, the interaction is not up, the loss of ecological damage to the server; Open clothes fast, players feel that you do not keep up with the pace of washing users, open the service slow, want to go to the new development of the player lost waiting patience ...


in order to ensure that each server to achieve the best open service effect, we are at any time to observe the number of new clothing online, not near the upper limit of new clothing, near the refresh point even if the limit is broken to open a new uniform. In accordance with the ecological status of the newly opened service, the amount of compensation is appropriate within the effective time limit.


never thought about it. In advance according to the pilot estimate set to open the service table All right, let us to now open more than 300 groups of servers, each group of the ecology is relatively healthy, and the implementation of such a troublesome open service strategy, did not appear once a mistake.


analysis, tuning, daily homework


"Juvenile Kingdoms" did a powerful data backstage, not only at any time to see the normal operating indicators data, but also to see the core of the pursuit of the participation of the point and latitude fill progress.


data analysis, player feedback, coupled with user research, user visits, and constantly identify product issues, through the activities of temporary adjustment of the ecology, and help research and development team through the version of a thorough solution. At the same time, these analyses also provide support for the launch and cooperation team.


Although read countless articles pointed out that simply through the data can not guide to make a good game, but in fact, the real meaning of the data is to help identify the most critical issues, and the response to the behavior of verification, this than blindly by guessing to deal with, or more reliable.


Although the title is 0 accidents, unknowingly is written the whole "juvenile kingdoms" before the public test preparation and after the public test response. These are not just for reducing accidents, but most of them are for more stable and lasting products. In the game release process, less than two mistakes, definitely better than a version of doing, if the consequences of each accident and the effect of the update to do, probably will come to this conclusion. So again, S-class product distribution relies on hard strength, stability is the first productivity.


--from Juvenile Kingdoms Operation Director: Green soybean