Residential rice technology to promote the application architecture and the development of personnel organization Structure _ framework

Original address: http://geek.csdn.net/news/detail/84944

Author: Li Zhihui, Home Rice CTO, worked for Alibaba and Intel Asia Pacific Research and Development Center, engaged in large-scale website, distributed system, large data platform research and development work. "Large Web site technology architecture-core principles and case analysis," a book.

In recent years, the wave of Internet entrepreneurship has been surging, all kinds of internet start-up companies have sprung up. Technology as an important part of Internet entrepreneurship, but also unprecedented attention. The development of Internet enterprises is usually explosive growth, in a very short period of time, business size, the growth of hundreds of thousands of users, the Web site's technical framework presents a great challenge.

This paper takes home meter network as an example to share with you in a typical Internet start-up company, how technology quickly responds to business changes and constantly reconstructs and optimizes system architectures to meet business needs. Technical team is how to continuously reorganize and optimize the rapid development and growth, adapt to the changes in business and technology architecture. I. The changes in the scale of residence meter business

Home Meter was founded in the end of 2014, is a focus on campus e-commerce Internet enterprises. Just over a year's time, the company's business covers nearly 200 cities, more than 1000 colleges and universities, more than 10,000 dormitory buildings, daily orders 200,000, peak orders 500,000.

Correspondingly, the size of the technical team from the beginning of the start-up of the three engineers, developed into a 50-person team. The company's business scale changes as shown in Figure 1.

Fig. 1 The change of residential rice business scale and the change of technical structure of dwelling rice

Like all start-up internet companies, the early system architecture of home meters is simple. Four main business systems: buyer system, seller system, supply chain system, operation support System, the core application system of the company. The nginx serves as a front-end Web server for mobile apps and mobile Web services through load balancing services. As shown in Figure 2.

Fig. 2 Residential Meter System Architecture 1.0

Such a simple system architecture is not a problem in the early days of the company, when the daily orders only thousands of, the system's ability to deal with is not the main problem at the time. But with the rapid growth of users, goods and orders, the pressure of the system is increasing, the main performance is that the load pressure of database is especially high, and the latency of database response is increased. At that time the company's business objectives are daily orders 200,000, peak order 500,000, the result of performance testing is that the current system architecture is not enough to support such orders.

The solution is to increase caching and database master-slave separation. Add Redis cache to the application service layer to cache business objects. In front of the use of Third-party CDN services, caching pictures, JS and other static files. and the data Analysis task is migrated to the large data platform to reduce the database access pressure. The reconstructed system is shown in Figure 3.

Fig. 3 Residential meter System Architecture 2.0

The 2.0 version of the architecture is a great boost to system performance and processing power, but as the system becomes more complex, many features are repeatedly developed, the duration of new requirements is growing and the number of bugs is increasing. The decision was made to use distributed services to deploy reusable functional modules as distributed services for use by individual business systems, thereby increasing development efficiency and maintenance costs.

At the same time, with the continuous development of business scale, another problem is highlighted: Order table data volume increased dramatically, at such a rate, the order Form table of data will soon exceed the database storage limit. At that time, there were two scenarios to consider, one being the distributed database, and splitting the order table into multiple physical libraries. The other is hot and cold separation, which migrates historical orders to MongoDB and only provides read-only query operations. The technical team went through the tradeoff and finally chose the second option. The latest system architecture is shown in Figure 4.

Fig. 4 The structure of residential meter system 3.0 three, the change of residence Rice technical team

The early home Rice technical team has only three engineers, almost no division of labor, everyone is the entire stack of engineers, where the need to do what. With the company gradually growing, the size of the technical team is also changing, when the team has more than 10 people, it must be organized division of labor. The initial grouping is done according to the professional functions of the engineers, that is, back-end group, app group, front-end group. As shown in Figure 5, the benefit of such groupings is that engineers of the same professional skills in a group are more likely to communicate and collaborate with each other.

Figure 5 Residential Rice Technical Team Organization 1.0

When the team size is small, only more than 10 people, the product is not much, only one or two products, such an organization can be effective operation. However, when the number of dozens of, the product has five or six times, each product needs to be developed across a number of technical teams, communication and coordination of the rapid increase in the cost of distribution by product division is more conducive to improve development efficiency, organizational structure as shown in Figure 6.

Figure 6 Residential Rice technical Team Organization 2.0

As the team grows and the division of labor is more detailed, the organizational structure needs to be refined, as shown in Figure 6.

Figure 7 Residential Rice technical Team Organization 3.0

Technical department to set up a special framework group, performance testing, performance optimization, architecture reconfiguration, process improvement and other business-related technical transformation, and product development team to support technology, is the technical department of the Fire Brigade and special forces. Iv. Summary

In today's perfect cloud computing and Internet technology, technology is hardly a barrier to entrepreneurship for most start-up internet companies. If the business model is correct, the recognition of the market and the pursuit of capital, the rapid development of business scale, even if there are some errors and lag in technology, will not cause serious damage to business development.
Home meters in their own brief development process, rapid business development of technology to put forward a variety of challenges, technical team has been scrambling to deal with, but through continuous evolution, experience again and again the rebirth and Bath fire, after all, or grow up.

Spengie Yue: Home meters of this model is worthy of small micro-Internet enterprises, of course, executive power is the first. To technology to promote team building, the inevitable, staffing can also do optimization.