How to create a real-time video site, JustinTV to teach you

The Justin.tv,youtube threat, through 30 million independent visits per month, adds 30 hours of video per minute each day, while YouTube has only 23, so has lost YouTube in the gaming video upload area

The following platform from the Justin.tv real-time video system, their architectural details, from what they should learn from a number of aspects for everyone to explain.

Start with the platform that you use:

twice--Agent service system, mainly using buffering to optimize Application server load

xfs--File System

haproxy--for tcp/http Load Balancing

LVS Stack and idirectord--high reliability

Ruby on rails--Application Server system

Nginx--web Server System

postgresql--database for users and meta data

mongodb--Database for internal analysis

memcacheddb--database for storing frequently modified data

syslog-ng--Log Service System

Rabitmq--job system

puppet--Create service

git--Source Code Control

wowza--flash/h.264 video Server and many Java-written custome modules

usher--Logical control server playing video streaming

s3--for storing small mirrors

Some statistical data of Justin.tv

4 data centers covering the entire U.S.

There are more than 2000 streams of data flowing at any one time

New 30-hour video per minute every day

30 million independent visits per month (excluding multiple visits by the same user)

Real-time network traffic is around 45G per second