Use nginx as the Server Load balancer and Web Cache Server

Use nginx as the Server Load balancer and Web Cache Server

Nginx's Web Cache service mainly consists of proxy_cache instruction sets and fastcgi_cache instruction sets. In the latest Nginx version 0.8.32, proxy_cache and fastcgi_cache are well-developed and can replace Squid and be used as the Server Load balancer server and Web Cache Server.

Nginx versions 0.7.48 and later support cache functions similar to Squid. This cache uses the URL and related combinations as the Key and stores them on the hard disk after md5 hash. Therefore, it supports any URL link, it also supports non-404/301 status codes such as 302/200. Although the official Nginx Web Cache service can only set an expiration time for a specified URL or status code, unlike the Squid PURGE command, you can manually clear the specified cache page. However, A third-party Nginx module can clear the cache of a specified URL.

The Nginx Web Cache service consists of the proxy_cache instruction sets and fastcgi_cache instruction sets. The former is used to cache the back-end content source server for reverse proxy, the latter is mainly used to cache FastCGI dynamic programs. The two functions are basically the same.

In the latest Nginx 0.8.32, proxy_cache and fastcgi_cache have been well-developed. In addition, the third-party ngx_cache_purge module (used to clear the cache of the specified URL) can completely replace Squid. We have used the proxy_cache cache function of Nginx in the production environment for more than two months, which is very stable and not inferior to Squid.

In terms of functions, Nginx already has the Web cache acceleration function of Squid and the function of clearing the specified URL cache. In terms of performance, Nginx's use of multi-core CPU is much better than Squid. In addition, Nginx is much more powerful than Squid in reverse proxy, Server Load balancer, health check, backend server failover, Rewrite, and ease of use. This allows an Nginx instance to be used as both the "Server Load balancer" and "Web Cache Server.

1. Compile and install Nginx Server Load balancer and cache server in Linux:

1. Ulimit-SHn65535
2. Wgetftp: // ftp. csx. cam. ac. uk/pub/software/programming/pcre/pcre-8.00.tar.gz
3. Tarzxvfpcre-8.00.tar.gz
4. Cdpcre-8.00/
5. ./Configure
6. Make & makeinstall
7. Cd ../
9. Wgethttp: // labs.frickle.com/files/ngx_cache_purge-1.0.tar.gz
10. Tarzxvfngx_cache_purge-1.0.tar.gz
12. Wgethttp: // nginx.org/download/nginx-0.8.32.tar.gz
13. Tarzxvfnginx-0.8.32.tar.gz
14. Cdnginx-0.8.32/
15. ./Configure-user = www-group = www-add-module = ../ngx_cache_purge-1.0-prefix =/usr/local/webserver/nginx-with-http_stub_status_module-with-http_ssl_module
16. Make & makeinstall
17. Cd ../

2. the/usr/local/webserver/nginx/conf/nginx. conf configuration file is as follows:

1. Userwwwwww;
3. Worker_processes8;
5. Error_log/usr/local/webserver/nginx/logs/nginx_error.logcrit;
7. Pid/usr/local/webserver/nginx. pid;
9. # Specifiesthevalueformaximumfiledescriptorsthatcanbeopenedbythisprocess.
10. Worker_rlimit_nofile65535;
12. Events
13. {
14. Useepoll;
15. Worker_connections65535;
16. }
18. Http
19. {
20. Includemime. types;
21. Default_typeapplication/octet-stream;
23. Charsetutf-8;
25. Server_names_hash_bucket_size128;
26. Client_header_buffer_size32k;
27. Large_client_header_buffers432k;
28. Client_max_body_size300m;
30. Sendfileon;
31. Tcp_nopushon;
33. Keepalive_timeout60;
35. Tcp_nodelayon;
37. Client_body_buffer_size512k;
38. Proxy_connect_timeout5;
39. Proxy_read_timeout60;
40. Proxy_send_timeout5;
41. Proxy_buffer_size16k;
42. Proxy_buffers464k;
43. Proxy_busy_buffers_size128k;
44. Proxy_temp_file_write_size128k;
46. Gzipon;
47. Gzip_min_length1k;
48. Gzip_buffers416k;
49. Gzip_http_version1.1;
50. Gzip_comp_level2;
51. Gzip_typestext/plainapplication/x-javascripttext/cssapplication/xml;
52. Gzip_varyon;
54. # Note: The paths specified by proxy_temp_path and proxy_cache_path must be in the same partition.
55. Proxy_temp_path/data0/proxy_temp_dir;
56. # Set the name of the Web cache area to cache_one. The size of the memory cache space is 200 MB. cache is cleared once a day, and the size of the hard disk cache space is 30 GB.
57. Proxy_cache_path/data0/proxy_cache_dirlevels = 1: 2keys_zone = cache_one: 200 minactive = 1dmax_size = 30g;
59. Upstreambackend_server {
60. Server192.168.8.43: 80 weight = 1max_fails = 2fail_timeout = 30 s;
61. Server192.168.8.44: 80 weight = 1max_fails = 2fail_timeout = 30 s;
62. Server192.168.8.45: 80 weight = 1max_fails = 2fail_timeout = 30 s;
63. }
65. Server
66. {
67. Listen80;
68. Server_namewww.yourdomain.com192.168.8.42;
69. Indexindex.htmlindex.htm;
70. Root/data0/htdocs/www;
72. Location/
73. {
74. # If the backend server returns errors such as 502, 504, and execution timeout, the request is automatically forwarded to another server in the upstream Server Load balancer pool for failover.
75. Proxy_next_upstreamhttp_502http_504errortimeoutinvalid_header;
76. Proxy_cachecache_one;
77. # Set different cache times for different HTTP Status Codes
78. Proxy_cache_valid20030412h;
79. # Combine domain names, Uris, and parameters into the Key values of the Web cache. Nginx hashes the cached content to the second-level cache directory based on the Key values.
80. Proxy_cache_key $ host $ uri $ is_args $ args;
81. Proxy_set_headerHost $ host;
82. The proxy_set_headerX-Forwarded-For $ remote_addr;
83. Proxy_passhttp: // backend_server;
84. Expires1d;
85. }
87. # It is used to clear the cache. If a URL is http: // 192.168.8.42/test.txt, you can clear the cache of the URL by accessing http: // 192.168.8.42/purge/test.txt.
88. Location ~ /Purge (/.*)
89. {
90. # Only the specified IP address or IP segment is allowed to clear the URL cache.
91. Allow127.0.0.1;
92. Allow192.168.0.0/16;
93. Denyall;
94. Proxy_cache_purgecache_one $ host $1 $ is_args $ args;
95. }
97. # Dynamic applications whose extensions end with. php,. jsp, And. cgi are not cached.
98. Location ~. * \. (Php | jsp | cgi )? $
99. {
100. Proxy_set_headerHost $ host;
101. The proxy_set_headerX-Forwarded-For $ remote_addr;
102. Proxy_passhttp: // backend_server;
103. }
105. Access_logoff;
106. }
107. }

3. Start Nginx:

1. /Usr/local/webserver/nginx/sbin/nginx

4. Example of clearing the specified URL cache:

Address: http://blog.s135.com/nginx_cache/