CentOS FASTDFS Multi-server multi-drive multi-group configuration detailed

Before saying the text, thank happy_fish100 for providing the FASTDFS, lightweight Distributed File server.

With the amount of users, pictures, videos and so on will continue to increase, this time a hard disk may not be enough, you need to add hard disk. When the hard disk does not add, you need to increase the server. The same set of servers, file server things are the same, different groups of servers, have different files, different groups, and co-organized all the contents of the file server.

The following is the installation of the configuration process, the method here, the root developer provides a different method, I did not use the Fastdfs-nginx-module, through the configuration Nginx implementation of the Fastdfs-nginx-module function.

One, Fastdfs's download

Address: http://sourceforge.net/projects/fastdfs/files/FastDFS%20Server%20Source%20Code/

Two, server, and system

I use the CentOS 6.5 x86_64, Fastdfs v5.01 architecture as follows:

Architecture diagram

Here the tracker is a single point, if out of trouble on the depressed, had once done once more tracker, but the version is relatively old . Please refer to:FASTDFS multi-server configuration

Third, install Fastdfs and Nginx

1, install Nginx

View copy print?

2. installation, gcc,automake,autoconf and other dependent packages
4. [email protected] download]$ Yum install gettext gettext-devel libxft libxft-devel libxpm libxpm-devel\
6. Automake autoconf libxtst-devel gtk+-devel gcc zlib-devel libpng-devel gtk2-devel glib-devel
10. Installing Fastdfs
12. [Email protected] download]# tar zxf fastdfs_v5.01.tar.gz
14. [Email protected] download]# CD Fastdfs
16. [Email protected] download]#./make.sh
18. [[email protected] download]#./make.sh Install
22. Installation is successful with the following content
24. [Email protected] fdfs]# ll/usr/local/bin/|grep Fdfs
26. -rwxr-xr-x 1 root root 522870 July 4 03:20 fdfs_appender_test
28. -rwxr-xr-x 1 root root 522823 July 4 03:20 fdfs_appender_test1
30. -rwxr-xr-x 1 root root 513975 July 4 03:20 fdfs_append_file
32. -rwxr-xr-x 1 root root 513393 July 4 03:20 FDFS_CRC32
34. -rwxr-xr-x 1 root root 513927 July 4 03:20 fdfs_delete_file
36. -rwxr-xr-x 1 root root 514329 July 4 03:20 fdfs_download_file
38. -rwxr-xr-x 1 root root 514093 July 4 03:20 fdfs_file_info
40. -rwxr-xr-x 1 root root 525024 July 4 03:20 fdfs_monitor
42. -rwxr-xr-x 1 root root 1179642 July 4 03:20 fdfs_storaged
44. -rwxr-xr-x 1 root root 529805 July 4 03:20 fdfs_test
46. -rwxr-xr-x 1 root root 527726 July 4 03:20 fdfs_test1
48. -rwxr-xr-x 1 root root 655761 July 4 03:20 fdfs_trackerd
50. -rwxr-xr-x 1 root root 514173 July 4 03:20 Fdfs_upload_appender
52. -rwxr-xr-x 1 root root 514951 July 4 03:20 fdfs_upload_file

2, install Nginx

1. [[email protected] fdfs]# Yum install Nginx

All machines have the same Fastdfs and Nginx installation methods.

Four, configure the 192.168.10.219 server

1, configuring Tracker and storage

View copy print?

1. [Email protected] fdfs]# vim/etc/fdfs/tracker.conf
3. port=22122 #设置tracker的端口号
4. base_path=/Var/www/fastdfs #设置tracker的数据文件和日志目录 (pre-creation required)

If you are tuning, refer to: http://bbs.chinaunix.net/forum.php?mod=viewthread&tid=1941456

View copy print?

2. [Email protected] fdfs]# vim/etc/fdfs/storage.conf
6. Group_name=group1 #组名, modify according to the actual situation
8. port=23000 #设置storage的端口号
10. base_path=/Var/www/fastdfs #设置storage的日志目录 (pre-creation required)
12. Store_path_count=1 #存储路径个数, need to match Store_path number
14. store_path0=/Var/www/fastdfs #存储路径
16. tracker_server=192.168.10.219:22122 #tracker服务器的IP地址和端口号

Nginx Configuration of 2,tracker

View copy print?

2. [Email protected] nginx]# cat/etc/nginx/nginx.conf #配置主配置文件
4. User Nginx;
6. Worker_processes 1;
8. Events {
10. Worker_connections 65535; #最大链接数
12. Use epoll; #新版本的Linux可使用epoll加快处理性能
14. }
16. Error_log/Var/log/nginx/error.log;
18. PID/Var/run/nginx.pid;
22. HTTP {
24. Server_names_hash_bucket_size 128;
26. Client_header_buffer_size 32k;
28. Large_client_header_buffers 4 32k;
30. Client_max_body_size 300m;
32. Sendfile on;
34. Tcp_nopush on;
36. Proxy_redirect off;
38. Proxy_set_header Host $http _host;
40. Proxy_set_header x-real-ip $remote _addr;
42. Proxy_set_header x-forwarded-for $proxy _add_x_forwarded_for;
44. Proxy_connect_timeout 90;
46. Proxy_send_timeout 90;
48. Proxy_read_timeout 90;
50. Proxy_buffer_size 16k;
52. Proxy_buffers 4 64k;
54. Proxy_busy_buffers_size 128k;
56. Proxy_temp_file_write_size 128k;
60. Log_format main ' $remote _addr-$remote _user [$time _local] "$request" '
62. ' $status $body _bytes_sent ' $http _referer '
64. ' "$http _user_agent" "$http _x_forwarded_for";
68. Access_log/Var/log/nginx/access.log main;
72. #设置缓存存储路径, storage mode, allocated memory size, disk maximum space, cache age
74. Proxy_cache_path/var/cache/nginx/proxy_cache levels=1:2 keys_zone=http-cache:500m max_size=10g inactive=30d;
76. Proxy_temp_path/var/cache/nginx/proxy_cache/tmp;
80. Upstream Fdfs_group1 {#设置group1的服务器
82. Server 192.168.10.209:8080 weight=1 max_fails=2 fail_timeout=30s;
84. Server 192.168.10.219:8080 weight=1 max_fails=2 fail_timeout=30s;
86. }
90. Upstream Fdfs_group2 {#设置group2的服务器
92. Server 192.168.10.103:10000 weight=1 max_fails=2 fail_timeout=30s;
94. }
98. include/etc/nginx/conf.d/*.conf;
100. }

View copy print?

2. [Email protected] fdfs]# cat/etc/nginx/conf.d/tracker.conf #配置nginx的tracker
4. server {
6. Listen 80; #设置服务器端口
8. server_name 192.168.10.219;
12. location/group1/m00 {#设置group1的负载均衡参数
14. Proxy_next_upstream http_502 http_504 error timeout invalid_header;
16. Proxy_cache Http-cache;
18. Proxy_cache_valid 304 12h;
20. Proxy_cache_key $uri$is _args$args;
22. Proxy_pass http://fdfs_group1;
24. Expires 30d;
26. }
30. Location ~*/group2/(m00| M01) {#设置group2的负载均衡参数
32. Proxy_next_upstream http_502 http_504 error timeout invalid_header;
34. Proxy_cache Http-cache;
36. Proxy_cache_valid 304 12h;
38. Proxy_cache_key $uri$is _args$args;
40. Proxy_pass http://fdfs_group2;
42. Expires 30d;
44. }
46. }

View copy print?

1. [Email protected] conf.d]# cat/etc/nginx/conf.d/storage.conf #配置nginx的storage
2. Server
3. {
4. Listen 8080;
5. server_name 192.168.10.219;
7. location/group1/m00/{
8. Root/var/www/fastdfs/data;
9. Rewrite ^/group1/m00/(. *)/break ;
10. }
12. }

3, start Tracker,storage and Nginx

View copy print?

1. Start
2. [Email protected] fdfs]#/usr/local/bin/fdfs_trackerd/etc/fdfs/tracker.conf restart
3. [Email protected] fdfs]#/usr/local/bin/fdfs_storaged/etc/fdfs/storage.conf restart
4. [[email protected] fdfs]#/etc/init.d/nginx start

Here is a point to note that is to start tracker in the start storage, if the Nginx directory is not built, create a, in the restart

Five. Configuring the 192.168.10.209 Server

1, Configuration Storage

View copy print?

2. [Email protected] fdfs]# vim/etc/fdfs/storage.conf
6. Group_name=group1 #组名, modify according to the actual situation
8. port=23000 #设置storage的端口号
10. base_path=/Var/www/fastdfs #设置storage的日志目录 (pre-creation required)
12. Store_path_count=1 #存储路径个数, need to match Store_path number
14. store_path0=/Var/www/fastdfs #存储路径
16. tracker_server=192.168.10.219:22122 #tracker服务器的IP地址和端口号

2,nginx Configuration

View copy print?

1. [Email protected] conf.d]# cat/etc/nginx/conf.d/storage.conf #配置storage
2. Server
3. {
4. Listen 8080;
5. server_name 192.168.10.209;
7. location/group1/m00/{
8. Root/var/www/fastdfs/data;
9. Rewrite ^/group1/m00/(. *)/break ;
10. }
12. }

3, start

View copy print?

1. Start
2. [Email protected] fdfs]#/usr/local/bin/fdfs_storaged/etc/fdfs/storage.conf restart
3. [[email protected] fdfs]#/etc/init.d/nginx start

Six, configure 192.168.10.103 server

1, Configuration Storage

View copy print?

2. [Email protected] fdfs]# vim/etc/fdfs/storage.conf
6. Group_name=group2 #组名, modify according to the actual situation
8. port=23000 #设置storage的端口号
10. base_path=/Var/www/fastdfs #设置storage的日志目录 (pre-creation required)
12. store_path_count=2 #存储路径个数, need to match Store_path number
14. store_path0=/Var/www/fastdfs #存储路径
16. STORE_PATH1=/MNT/USB/FASTDFS2 #硬盘2的存储路径
18. tracker_server=192.168.10.219:22122 #tracker服务器的IP地址和端口号

One thing to note here is that there are two hard drives, and there are two directories in the file

2, configuring Nginx

View copy print?

2. [Email protected] conf.d]# cat/etc/nginx/conf.d/storage.conf #配置storage
4. Server
6. {
8. Listen 10000;
10. server_name 192.168.10.103;
14. location/group2/m01/{
16. Root/mnt/usb/fastdfs2/data;
18. Rewrite ^/group2/m01/(. *)/break ;
20. }
24. location/group2/m00/{
26. Root/var/www/fastdfs/data;
28. Rewrite ^/group2/m00/(. *)/break ;
30. }
34. }

3, start

View copy print?

1. Start
2. [Email protected] fdfs]#/usr/local/bin/fdfs_storaged/etc/fdfs/storage.conf restart
3. [[email protected] fdfs]#/etc/init.d/nginx start

Here is the installation configuration, one thing to note:

is to access the file server file, the address to use tracker address, for example:

Http://192.168.10.219/group2/M01/00/00/wKgKZ1PAEquAbLj1AAK4TxGeCvM649.jpg

CentOS FASTDFS Multi-server multi-drive multi-group configuration detailed