Golang High Performance practice in the video live platform (including ppt download)

This is a creation in Article, where the information may have evolved or changed.

                                                                                                     
Editor's note: This is Yang Wuming on February 27 in the Gopher Beijing party speech based on the finishing. Reprint please indicate from the highly available architecture public number "archnotes". 


 
 

  
  
 
   
Yang Wuming, chief architect of Panda TV, has served as the head of PC online gaming technology architecture for Qihoo, formerly the Senior backend development and technical expert of Sina Weibo platform. Rich practical experience in large-scale Internet architecture, good at back-end basic services and component development, especially high performance, high concurrency, big data business scenarios.
 
  
 
 

Panda TV is a live video platform, the first introduction of our system operating environment, the following 6 services are just a part of our dozens of services, due to the high concurrency and importance, so become Golang small trial sledgehammer the first high-performance high concurrency services.



The large service is broken down and then serviced independently deployed, making it easier to deploy, and easy to optimize and upgrade with one point of detail. The capabilities of most services are common, such as smooth restart, multi-engine room deployment, and so on. 



With regard to online services, if 10 million users are online, even if every 30 seconds online HTTP sends a dot, then there is a 300,000 + interface for QPS per second.

Golang provides HTTP server performance is very good, a general engineer if the single virtual machine to support 1w-2w per second of the volume of requests, then only 10-20 backend servers.

With other non-high-performance languages, the required machine can be doubled several times, C + + performance is sufficient, but the engineers are demanding.



Room service is the main service, the need for core protection, so the room service inside the section, a fine-grained split.

The content of the room information changes frequently also uses the independent storage, such as the number of people counting fields, the disadvantage is that each time to go to the room information will bring an additional number of visitors to the cost of service. This is one of the tradeoffs that architectural design requires.



Gift system is the standard of most video live platform, the domestic gift consumption habits of local tyrants many, peak gifts of the concurrency is very large, especially a lot of local tyrants on the brush.

The gift system has a slightly higher consistency requirement, so it is also an option to keep a single copy of the data to build multiple indexes, as well as to reduce the dependency on the transaction.



The interactive mode is a very good experience, more youthful, a large number of users like to interact with the host in this way.

Domestic network situation is more complex, preferably according to the user location to select the nearest corresponding operator of the single-line computer room access to the bomb screen message service, so that the barrage more timely. You can also use a BGP room, but the network bandwidth price will be much more expensive than a single line.

For large rooms, the message volume is particularly large, the host and users are not able to see, in the product strategy level can do some experience on the optimization.



Video Streaming experience is the most critical point of the overall platform , video CDN is a way for users to obtain the required streaming media technology, and solve the delay, lag and other issues. From a technical point of view do not rely only on a CDN provider or line, many of the industry's video live platform has made a pull-flow line, push the stream after the video (transcoding, forwarding) cluster is also an optimized point, do the mutual push is redundant partial push flow resources, but to optimize the experience and high availability of live stream is obvious.



The interface proxy service, which contains free business logic, is a public service that many companies have, which can be used to provide the intranet service with low cost. However, we need to consider the external network security policy, including authorization authentication, service relationship mapping, frequency limitation, business resource isolation and so on  . 



To see the final affirmation of our technology and business interests, the Panda TV technical team is recruiting Golang Engineers , all equipped with high-quality computer and DELL dual-screen large-screen display, and provide a challenging technical environment. Interested friends please sweep code into (also have a lot of PHP, front-end, operation, DBA and other technical posts). 


The above is the main content of this share, click to read the original text can download PPT.

Learn more about Yang Wuming: from 3000 yuan a month to the chief architect's experience

 reprint this article please indicate from the highly available architecture "archnotes" public number and includes the following two-dimensional code. 


                     

View Original: http://www.zoues.com/2016/10/20/golang%e5%9c%a8%e8%a7%86%e9%a2%91%e7%9b%b4%e6%92%ad%e5%b9%b3%e5%8f%b0%e7% 9a%84%e9%ab%98%e6%80%a7%e8%83%bd%e5%ae%9e%e8%b7%b5%ef%bc%88%e5%90%abppt%e4%b8%8b%e8%bd%bd%ef%bc%89/