Summary Notes of various major website architectures (continued)

Some time ago, I introduced my website architecture Summary Notes (MySpace, Flickr, YouTube, plentyoffish, Wikipedia). If you like the architecture, you can go and have a look. In the past two days, I have successively sorted out the Architecture Information of several excellent websites from the Internet, and sorted some articles into my own blog. Today I will share them with you, I hope to give you some inspiration. In addition, you are welcome to discuss it together. If you have better architecture information, you can share it with us :)

1. Google Architecture

The boss certainly needs to put it first. Google's architecture is not something that we can understand in a day or two. Here we just outline it:

--GFS, Google's powerful, Scalable Distributed File System for large-scale data-intensive applications

--MapreduceGoogle's distributed parallel computing system, gfs stores data, while mapreduce processes data in the fastest and most reliable way.

--BigtableGoogle is a solution based on GFS and mapreduce to store structured data. with this solution, not only structured data can be stored, but also load balancing decisions can be better managed and made.

Google architecture details

2. Youku Network Architecture

In China, I can't go to YouTube, but I can only look at Youku. Youku is doing a good job in China, and the video loading speed is obviously faster than that of Tudou, let's look at his architecture:

-- A self-built modular CMS system with flexible front-end

-- MySQL databases can be flexibly scaled horizontally from a single MySQL Server (just running) to simple MySQL master-slave replication, SSD optimization, vertical database sharding, and horizontal sharding database sharding.

-- To avoid memory copy and Memory Lock, no (rarely) content cache is used.

-- The core is to build a complete CDN network. the proximity principle allows you to obtain video information from the server closest to you when watching videos, so we see Youku is faster than Tudou, and the reason is here.

Youku network architecture details

3. Twitter Architecture

Twitter is simple, but complicated, and tangled. The originator of these 140 words made a Chinese XXX Very cool. Let's talk about his architecture:

-- Extensive platforms:

• Ruby on Rails: Web Application Framework
• Erlang: Universal concurrency-oriented programming language, open source project address: http://www.erlang.org/
• AWStats: Real-time log analysis system: open source project address: http://awstats.sourceforge.net/
• Memcached: distributed memory cache Creation
• Starling: lightweight Message Queue developed by ruby
• Varnish: high-performance open source HTTP accelerator
• Kestrel: message-oriented middleware written by Scala. Open-Source Project address: http://github.com/robey/kestrel
• Comet server: comet is an Ajax persistent connection technology. With comet, servers can actively push data to Web browsers to avoid performance loss caused by client polling.
• Libmemcached: A memcached Client
• Use the MySQL database server
• Mongrel: Ruby HTTP server, specifically for rails, open source project address: http://rubyforge.org/projects/mongrel/
• Munin: Server Monitoring Program, Project address: http://munin-monitoring.org/
• Nagios: network monitoring system, project address: http://www.nagios.org/

-- Refine memcached and create vector cache, row cache, fragmeng cache, and cache pool page cache.

-- Awesome message queue, a distributed queue written in Ruby Starling

Twitter architecture details

4. yupoo website architecture

A best image service provider in China, although there is still a gap with Flickr, but it is also good, saying that image and video are very server-burning and bandwidth-consuming, it is not easy to have such expensive bandwidth in China. Well, let's take a look at his architecture:

-- SQUID: It seems that the image cache is quite good, and it is still distributed. It can hit hard disks and memory, and the speed is not bad.

-- Mogilefs Image Storage

-- MySQL database sharding design, vertical database sharding, horizontal sharding, and cross-database association query

-- Transparent Cache Design

Yupoo architecture details

5. Amazon website architecture

Since its childhood, Amazon has now become the online retailer with the largest variety of commodities in the world and the world's 2nd largest Internet companies. It looks like a great deal, and the architecture must be very sharp. Let's take a look at the following:

-- Platform: Linux, Oracle, C ++, Perl, Mason, Java, JBoss, and servlets

-- Dynamo key-value Storage Architecture, for more information about Dynamo, see: http://baike.baidu.com/view/2982765.html? Fromtaglist

Amazon architecture details

Well, let's talk about these items first. If you have time, let's look at them again. Actually, the architecture is better than watching Avatar, so it's good for you to see the health of your body and body.

Finally, you are welcome to visit my qingteng house. It's boring to have a blog... Good night everyone!