All-world top PHP station Facebook backstage Technology Quest

The world's top PHP station Facebook backstage Technology Quest
Hadoop and Hive

Hadoop is an open-source map-reduce implementation that allows it to perform operations on big data. Facebook uses this for data analysis (and we all know that Facebook has a lot of data). Hive is originated from Facebook, making it possible for SQL queries to be used with Hadoop, making it easier for non-programmers to use.

Hadoop and Hive are open source (Apache projects), with a large number of followers, such as Yahoo and Twitter.

Thrift

There are several different languages and different services that Facebook uses. PHP is ultimately used for the front end, Erlang is used for chat, Java and C + + are also used in a variety of places, and perhaps there are other languages. Thrift is an internally developed cross-language framework that contacts languages so that they can work together so that they can interact with each other. This makes it easier for Facebook to keep its cross-language development.

Facebook has let thrift open source. More language support has been added to thrift.

Varnish

Varnish is an HTTP accelerator that can act as a load balancer and cache the contents, which can then be delivered at lightning speed.

Facebook uses Arnish to process photos and profile pictures and handle billions of of daily requests. Like everything else, varnish is open source.

Other things that keep Facebook running smoothly

We have mentioned the software that makes up the Facebook system and helps to run on a large scale. However, dealing with such a large system is a complex task, so we will list some of the other things that they keep on the smooth running of Facebook.

Progressive release and Dark start

Facebook has a so-called Gatekeeper system (Gatekeeper) that allows them to run two different sets of systems for different users. This allows Facebook to progressively release features, A/B testing, and only some features that are released for Facebook employees.

Gatekeeper also allows Facebook to implement a "dark start", which activates certain features before the user can use some features (because the user is unaware, so called a dark boot). This will serve as a real-world stress test to help uncover some of the dysfunction and other issues before the official launch. The dark start is usually two weeks before the official launch.

Profiling's Live system

Facebook's careful monitoring of its system, interestingly, it is also responsible for monitoring the performance of each PHP function in the production environment. Detects the configuration operation of each PHP environment. Use open source Tools, xhprof.

Progressive use of shutdown to improve performance

If there is a performance issue with Facebook running, one way to do this is to step off the less-important features to enhance Facebook's many core features.

Something we didn't mention.

We don't mention hardware-related things, but this is also an important part of improving scalability. For example, like other large sites, Facebook uses a CDN to handle static content. Facebook also has a huge data center that can help him expand more services.

Facebook's Open source scenario

Not only does Facebook use (and help) open source software such as linux,memcached, MySQL and Hadoop, as well as many other cases, it also contributes many of its in-house developed software.

Facebook is also open source for tornado, a high-performance Web server framework developed by the FriendFeed team. For an open source software listing, you can find it on Facebook's Open source page.

Original Address http://caifu.zol.com.cn/187/1878540.html

