1 版本信息
服務器使用的系統為centos7.1， fastdfs版本為5.05穩定版
服務器ip分別是：
172.27.12.65，作為tracker機器
172.27.12.61，作為group1的storage
172.27.12.67，作為group2的storage
2 FastDFS安裝配置
2.1 FastDFS安裝
2.1.1 下載FastDFS及相關
下載fastdfs-5.08：
wget https://codeload.github.com/happyfish100/fastdfs/zip/master
下載libfastcommon-master，1.27：
wget https://github.com/happyfish100/libfastcommon/archive/master.zip
下載fastdfs module：
wget https://github.com/happyfish100/fastdfs-nginx-module/archive/master.zip
下載nginx lua：
wget http://openresty.org/download/ngx_openresty-1.7.10.1.tar.gz
2.1.2 安裝FastDFS依賴
安裝編譯環境，執行命令：
sudo yum -y groupinstall 'Development Tools'
安裝libfastcommon，執行命令：
cd libfastcommon-master
./make.sh
sudo ./make.sh install
2.1.3 安裝FastDFS
cd fastdfs-5.05/
./make.sh
sudo ./make.sh install
2.2 FastDFS配置
添加用戶
sudo useradd fastdfs -M -s /sbin/nologin
創建文件夾
sudo mkdir -p /data/fdfs/
sudo chown -R fastdfs:fastdfs /data/fdfs
2.2.1 配置tracker服務器
在65服務器上配置tracker服務器，只列出修改的內容，未列出內容無需修改。添加配置文件：
sudo cp /etc/fdfs/tracker.conf.sample /etc/fdfs/tracker.conf
修改tracker配置文件：
base_path=/data/fdfs
run_by_group=fastdfs
run_by_user=fastdfs
2.2.2 啟動tracker
執行啟動命令：
sudo /usr/bin/fdfs_trackerd /etc/fdfs/tracker.conf start
2.2.3 配置storage服務器
分別在61和67服務器，修改storage.conf文件，只列出修改的內容，未列出內容無需修改。添加storage配置文件：
cd /etc/fdfs
sudo cp storage.conf.sample storage.conf
修改group1的storage配置文件
group_name=group1
run_by_group=fastdfs
run_by_user=fastdfs
base_path=/data/fdfs
tracker_server=192.168.1.50:22122
store_path0=/data/fdfs
修改group2的storage的配置文件
run_by_group=fastdfs
run_by_user=fastdfs
group_name=group2
base_path=/data/fdfs
tracker_server=192.168.1.51:22122
store_path0=/data/fdfs
2.2.4 啟動storage
分別在61和67服務器執行啟動storage命令：
sudo /usr/bin/fdfs_storaged /etc/fdfs/storage.conf start
storage正確啟動后，需要創建連接。分別在61和67服務器，執行命令：
sudo ln -s /data/fdfs/data /data/fdfs/data/M00
2.2.5 配置storage的測試客戶端
為storage服務器添加配置客戶端文件
cd /etc/fdfs
sudo cp client.conf.sample client.conf
修改client.conf文件，未列出內容無需修改，修改項如下：
base_path=/data/fdfs
tracker_server=192.168.1.50:22122
3 Openresty Nginx Lua安裝和配置
3.1 Openresty Nginx Lua安裝
在/usr/yKF6600/fdfs目錄，下載並解壓fastdfs-nginx-module，執行命令：
wget https://github.com/happyfish100/fastdfs-nginx-module/archive/master.zip
unzip fastdfs-nginx-module-master.zip
在/usr/yKF6600/fdfs目錄，下載並解壓openresty nginx lua，執行命令：
wget http://openresty.org/download/ngx_openresty-1.7.10.1.tar.gz
tar -zxvf ngx_openresty-1.7.10.1.tar.gz
3.1.1 安裝ngx_openresty
安裝編譯環境
sudo yum install pcre-devel openssl openssl-devel
安裝ngx_openresty，在ngx_openresty目錄，執行
sudo ./configure --with-luajit --with-http_stub_status_module --with-http_ssl_module --with-http_realip_module --add-module=/usr/yKF6600/fastdfs/fastdfs-nginx-module-master/src
sudo gmake
sudo gmake install
創建nginx使用的目錄
sudo mkdir /data/ngx
sudo chown -R fastdfs:fastdfs /data
創建mod_fastdfs.conf文件
sudo cp /usr/yKF6600/fdfs/fastdfs-nginx-module-master/src/mod_fastdfs.conf /etc/fdfs/
3.2 配置ngx_openresty
3.2.1 修改mod_fastdfs.conf文件
分別咋61和67機器執行
sudo touch /data/ngx/mod_nginx.log
sudo chown –R fastdfs:fastdfs /data
61機器為group1的storage服務器，修改/etc/fdfs/mod_fastdfs.conf文件（未列出內容無需修改），修改的內容如下：
base_path=/data/ngx
tracker_server=192.168.1.36:22122
group_name=group1
store_path0=/data/fdfs
url_have_group_name = true
log_filename=/data/ngx/mod_nginx.log
group_count = 2
[group1]
group_name=group1
storage_server_port=23000
store_path_count=1
store_path0=/data/fdfs
[group2]
group_name=group2
storage_server_port=23000store_path_count=1
store_path0=/data/fdfs
67服務器為group2的storage服務器，修改/etc/fdfs/mod_fastdfs.conf（未列出內容無需修改），修改的內容如下：
base_path=/data/ngx
tracker_server=192.168.1.36:22122
group_name=group2
store_path0=/data/fdfs
url_have_group_name = true
log_filename=/data/ngx/mod_nginx.log
group_count = 2
[group1]
group_name=group1
storage_server_port=23000
store_path_count=1
store_path0=/data/fdfs
[group2]
group_name=group2
storage_server_port=23000
store_path_count=1
store_path0=/data/fdfs
3.2.2 添加http.conf和mine.types文件
分別在61和67服務器復制http.conf和mime.types到/etc/fdfs目錄
cd /usr/yKF6600/fdfs/fastdfs-5.05/conf
sudo cp http.conf mime.types /etc/fdfs/
3.2.3 配置nginx.conf文件
在61服務器上，修改group1的nginx的/usr/local/openresty/nginx/conf/nginx.conf
#user nobody;
user fastdfs;
worker_processes 1;
error_log /data/ngx/error.log;
events {
worker_connections 1024;
}
http {
include mime.types;
default_type application/octet-stream;
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
access_log /data/ngx/access.log main;
sendfile on;
#tcp_nopush on;
#keepalive_timeout 0;
keepalive_timeout 65;
#gzip on;
server {
listen 80;
server_name localhost;
charset utf8;
location /group1/M00 {
alias /data/fdfs/data;
ngx_fastdfs_module;
}
}
}
在67服務器上，修改nginx.conf，因為group2的nginx.conf文件內容只有如下內容和group1的nginx.conf內容不一致，其他按照group1的nginx.conf配置修改：
location /group2/M00 {
alias /data/fdfs/data;
ngx_fastdfs_module;
}
3.2.4 啟動或者重載入nginx配置文件
啟動nginx命令：
sudo /usr/local/openresty/nginx/sbin/nginx
重新載入nginx配置：
sudo /usr/local/openresty/nginx/sbin/nginx -s reload
4 上傳測試
創建test.html頁面，輸入如下內容
test fastdfs
上傳測試文件，命令為：
/usr/bin/fdfs_test /etc/fdfs/client.conf upload test.html
返回結果類似為為：
[2016-05-04 02:06:56] DEBUG - base_path=/data/fdfs, connect_timeout=30, network_timeout=60, tracker_server_count=1, anti_steal_token=0, anti_steal_secret_key length=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s, use_storage_id=0, storage server id count: 0
tracker_query_storage_store_list_without_group:
server 1. group_name=, ip_addr=172.27.12.61, port=23000
group_name=group1, ip_addr=172.27.12.61, port=23000
storage_upload_by_filename
group_name=group1, remote_filename=M00/00/00/rBAEYVcpWTqAWVsvAAAADcvBslg32.html
source ip address: 172.27.12.61
file timestamp=2016-05-04 02:06:50
file size=13
file crc32=3418468952
example file url: http://172.27.12.61/group1/M00/00/00/rBAEYVcpWTqAWVsvAAAADcvBslg32.html
storage_upload_slave_by_filename
group_name=group1, remote_filename=M00/00/00/rBAEYVcpWTqAWVsvAAAADcvBslg32_big.html
source ip address: 172.27.12.61
file timestamp=2016-05-04 02:06:50
file size=13
file crc32=3418468952
example file url: http://172.27.12.61/group1/M00/00/00/rBAEYVcpWTqAWVsvAAAADcvBslg32_big.html
訪問上傳的頁面，執行命令：
curl http://172.27.12.61/group1/M00/00/00/rBAEYVcpWTqAWVsvAAAADcvBslg32_big.html
得到結果為：
test fdfs
如果無法成功上傳誤，可以在storage服務器上使用fdfs_monitor檢測是否有錯誤。命令為fdfs_monitor /etc/fdfs/storage.conf
以下是使用fdfs_monitor檢測為運行正常的結果：
[2016-05-04 17:36:37] DEBUG - base_path=/data/fdfs, connect_timeout=30, network_timeout=60, tracker_server_count=1, anti_steal_token=0, anti_steal_secret_key length=0, use_connection_pool=0, g_connection_pool_max_idle_time=3600s, use_storage_id=0, storage server id count: 0
server_count=1, server_index=0
tracker server is 172.27.12.65:22122
group count: 2
Group 1:
group name = group1
disk total space = 36426 MB
disk free space = 31228 MB
trunk free space = 0 MB
storage server count = 1
active server count = 1
storage server port = 23000
storage HTTP port = 8888
store path count = 1
subdir count per path = 256
current write server index = 0
current trunk file id = 0
Storage 1:
id = 172.27.12.61
ip_addr = 172.27.12.61 ACTIVE
http domain =
version = 5.05
join time = 2016-05-04 17:05:01
up time = 2016-05-04 17:05:01
total storage = 36426 MB
free storage = 31228 MB
upload priority = 10
store_path_count = 1
subdir_count_per_path = 256
storage_port = 23000
storage_http_port = 8888
current_write_path = 0
source storage id =
if_trunk_server = 0
connection.alloc_count = 256
connection.current_count = 0
connection.max_count = 0
total_upload_count = 0
success_upload_count = 0
total_append_count = 0
success_append_count = 0
total_modify_count = 0
success_modify_count = 0
total_truncate_count = 0
success_truncate_count = 0
total_set_meta_count = 0
success_set_meta_count = 0
total_delete_count = 0
success_delete_count = 0
total_download_count = 0
success_download_count = 0
total_get_meta_count = 0
success_get_meta_count = 0
total_create_link_count = 0
success_create_link_count = 0
total_delete_link_count = 0
success_delete_link_count = 0
total_upload_bytes = 0
success_upload_bytes = 0
total_append_bytes = 0
success_append_bytes = 0
total_modify_bytes = 0
success_modify_bytes = 0
stotal_download_bytes = 0
success_download_bytes = 0
total_sync_in_bytes = 0
success_sync_in_bytes = 0
total_sync_out_bytes = 0
success_sync_out_bytes = 0
total_file_open_count = 0
success_file_open_count = 0
total_file_read_count = 0
success_file_read_count = 0
total_file_write_count = 0
success_file_write_count = 0
last_heart_beat_time = 2016-05-04 17:31:37
last_source_update = 1970-01-01 08:00:00
last_sync_update = 1970-01-01 08:00:00
last_synced_timestamp = 1970-01-01 08:00:00
Group 2:
group name = group2
disk total space = 36426 MB
disk free space = 32921 MB
trunk free space = 0 MB
storage server count = 1
active server count = 1
storage server port = 23000
storage HTTP port = 8888
store path count = 1
subdir count per path = 256
current write server index = 0
current trunk file id = 0
Storage 1:
id = 172.27.12.67
ip_addr = 172.27.12.67 (ci-dmz-c03) ACTIVE
http domain =
version = 5.05
join time = 2016-05-04 17:33:01
up time = 2016-05-04 17:33:01
total storage = 36426 MB
free storage = 32921 MB
upload priority = 10
store_path_count = 1
subdir_count_per_path = 256
storage_port = 23000
storage_http_port = 8888
current_write_path = 0
source storage id =
if_trunk_server = 0
connection.alloc_count = 256
connection.current_count = 0
connection.max_count = 0
total_upload_count = 0
success_upload_count = 0
total_append_count = 0
success_append_count = 0
total_modify_count = 0
success_modify_count = 0
total_truncate_count = 0
success_truncate_count = 0
total_set_meta_count = 0
success_set_meta_count = 0
total_delete_count = 0
success_delete_count = 0
total_download_count = 0
success_download_count = 0
total_get_meta_count = 0
success_get_meta_count = 0
total_create_link_count = 0
success_create_link_count = 0
total_delete_link_count = 0
success_delete_link_count = 0
total_upload_bytes = 0
success_upload_bytes = 0
total_append_bytes = 0
success_append_bytes = 0
total_modify_bytes = 0
success_modify_bytes = 0
stotal_download_bytes = 0
success_download_bytes = 0
total_sync_in_bytes = 0
success_sync_in_bytes = 0
total_sync_out_bytes = 0
success_sync_out_bytes = 0
total_file_open_count = 0
success_file_open_count = 0
total_file_read_count = 0
success_file_read_count = 0
total_file_write_count = 0
success_file_write_count = 0
last_heart_beat_time = 2016-05-04 17:31:45
last_source_update = 1970-01-01 08:00:00
last_sync_update = 1970-01-01 08:00:00
last_synced_timestamp = 1970-01-01 08:00:00