Summary of various website Architectures

I remember paying attention to the website architecture more than once in the university, but every time I was familiar with it, I did not focus on recording it. After a while, I lost my mind on the various architectures. Over the past few days, I have been eager to learn more about the website architecture, record something for you to read later, and provide some useful information to those who want to know about it. The following is my summary note for this study, if you have any mistakes, please point out that you may also hope that this article will inspire others to express their opinions.

1. MySpace Architecture

Looking back at the growth history of MySpace, It was amazing that his architecture had basically gone through five milestones. Every stage was so hasty, helpless, bumpy, and wonderful, to survive, websites have to do everything they can to optimize the system architecture and satisfy users. His inspiration to our future generations is to discover the bottleneck of the system as soon as possible. Designers should have a forward-looking idea during design, or they may have to upgrade your product in such a rush in the future.
Here is a detailed description of the "five milestones.

2. Summary of the website architecture

Flickr.com is one of the most popular photo sharing websites on the Internet. Do you still remember Hamad Darwish, which took a wallpaper for Windows Vista? He just uploaded the photo to Flickr and was taken into consideration by Microsoft to become a professional photographer for Vista wallpapers.

-- Pair of serveriron's Load Balancing

-- SQUID: cache HTML and photos

-- Memcached for data caching

-- In particular, MySQL Databases use master-slave and shards technologies to achieve Load Balancing for MySQL databases, solve database bottlenecks, and achieve horizontal database scaling.

Here is his detailed architecture description

3. YouTube architecture Summary

This seems to be harmonious in China and requires Fan Qiang to access (somehow ). Look at his architecture:
-- NetScaler is used for load balancing and static content caching

-- Use Lighttpd as the Web server to provide video services

-- CDN backs up content in multiple places, so that the content is closer to the user and the chances are higher.

-- Using Google's bigtable, a distributed data storage and databaseShards: different users specify different shards,Use bigtable to back up images to different data centers,CodeCheck who is the most recent

Here is the detailed architecture description of YouTube.

4. Summary of plentyoffish Architecture

I think this is the most amazing thing. A person who spends 2 hours a day can maintain a daily PV of 3000 W, and is based on. NET (haha, finally give us. netProgramA good example ). Briefly describe his architecture:
-- Use Microsoft Windows as the server

-- Use ASP. NET Technology

-- Use IIS as a Web Container

-- Use Akamai CDN to cache webpages

-- Use foundry serveriron for Load Balancing

-- Sqlserver adopts the master-slave architecture. The two are responsible for read operations, and the master is responsible for write operations.

-- All request data is compressed using gzip.

Detailed architecture description of plentyoffish

5. Summary of Wikipedia Architecture

Wikipedia is a global multilingual encyclopedia collaboration program based on Wiki technology. It is also a network encyclopedia presented on the Internet, its purpose and purpose is to provide free encyclopedias for all mankind-a dynamic, free and global body of knowledge written in the language of their choice.

-- Geodns allows users to access the web address closest to their regionServer

--Load Balancing with LVS

--Use Lighttpd as an image server

--Use mediawiki Software

--A large number of caches ),Squid acts as the reverse proxy,Memcached for data caching

--Use a MySQL database cluster

Detailed introduction to Wikipedia Architecture

 

 

I have introduced this to you (MySpace, Flickr, YouTube, plentyoffish, Wikipedia). If you like the architecture, you can check it out. In the past two days, I have successively sorted out the Architecture Information of several excellent websites from the InternetArticleI sorted out another blog of my own and shared it with you today, hoping to inspire you. In addition, we welcome to discuss it together, if you have better architecture information, you can share it with us :)

1. Google Architecture

The boss certainly needs to put it first. Google's architecture is not something that we can understand in a day or two. Here we just outline it:

--GFS, Google's powerful, Scalable Distributed File System for large-scale data-intensive applications

--MapreduceGoogle's distributed parallel computing system, gfs stores data, while mapreduce processes data in the fastest and most reliable way.

--BigtableGoogle is a solution based on GFS and mapreduce to store structured data. with this solution, not only structured data can be stored, but also load balancing decisions can be better managed and made.

Google architecture details

2. Youku Network Architecture

In China, I can't go to YouTube, but I can only look at Youku. Youku is doing a good job in China, and the video loading speed is obviously faster than that of Tudou, let's look at his architecture:

-- A self-built modular CMS system with flexible front-end

-- MySQL databases can be flexibly scaled horizontally from a single MySQL Server (just running) to simple MySQL master-slave replication, SSD optimization, vertical database sharding, and horizontal sharding database sharding.

-- To avoid memory copy and Memory Lock, no (rarely) content cache is used.

-- The core is to build a complete CDN network. the proximity principle allows you to obtain video information from the server closest to you when watching videos, so we see Youku is faster than Tudou, and the reason is here.

Youku network architecture details

3. Twitter Architecture

Twitter is simple, but complicated, and tangled. The originator of these 140 words made a Chinese XXX Very cool. Let's talk about his architecture:

-- Extensive platforms:

• Ruby on Rails: Web Application Framework
• Erlang: General concurrency-orientedProgramming Language, Open source project address: http://www.erlang.org/
• AWStats: Real-time log analysis system: open source project address: http://awstats.sourceforge.net/
• Memcached: distributed memory cache Creation
• Starling: lightweight Message Queue developed by ruby
• Varnish: high-performance open source HTTP accelerator
• Kestrel: message-oriented middleware written by Scala. Open-Source Project address: http://github.com/robey/kestrel
• Comet server: comet is an Ajax persistent connection technology. With comet, servers can actively push data to Web browsers to avoid performance loss caused by client polling.
• Libmemcached: A memcached Client
• Use the MySQL database server
• Mongrel: Ruby HTTP server, specifically for rails, open source project address: http://rubyforge.org/projects/mongrel/
• Munin: Server Monitoring Program, Project address: http://munin-monitoring.org/
• Nagios: network monitoring system, project address: http://www.nagios.org/

-- Refine memcached and createVector cache,Row cache row cache,Fragmeng cache,Cache pool page Cache

-- Awesome message queue, a distributed queue written in Ruby Starling

Twitter architecture details

4. yupoo website architecture

A best image service provider in China, although there is still a gap with Flickr, but it is also good, saying that image and video are very server-burning and bandwidth-consuming, it is not easy to have such expensive bandwidth in China. Well, let's take a look at his architecture:

-- SQUID: It seems that the image cache is quite good, and it is still distributed. It can hit hard disks and memory, and the speed is not bad.

--Mogilefs Image Storage

-- MySQL database sharding design, vertical database sharding, horizontal sharding, and cross-database association query

-- Transparent Cache Design

Yupoo architecture details

5. Amazon website architecture

This Amazon store has becomeOnline retailers with the largest variety of goods in the world and the world's top 2nd Internet companies seem to be very good. The architecture must be very sharp. Let's take a look:

-- Platform: Linux, Oracle, C ++, Perl, Mason, Java, JBoss, and servlets

-- Dynamo key-value Storage Architecture, for more information about Dynamo, see: http://baike.baidu.com/view/2982765.html? Fromtaglist

Amazon architecture details

 

From: http://www.cnblogs.com/sxwgf/archive/2011/03/08/1977589.html