SwiftAll-In-One 安裝指南

author:錢立寬

email:[email protected]

date:2018-3-20

Swift All-In-One(SAIO)單機部署機器配置：

戴爾PowerEdge-T110-II伺服器一臺;

Intel Xeon四核處理器3.1G Hz 一個

網絡卡 一塊

記憶體 500G

作業系統：Ubuntu 14.04 LTS desktop

本機IP地址：10.200.25.223（固定IP）

PLEASE Keep These Cautions InMind :

一定要仔細閱讀每一個在接下來會出現的配置檔案，一定要注意IP地址和埠號配置的對不對

安裝測試成功。

1）          安裝依賴

1.     sudoapt-get update

2.     sudoapt-get install curl gcc memcached rsync sqlite3 xfsprogs \

                     git-core libffi-devpython-setuptools \

                     liberasurecode-devlibssl-dev

3.     sudoapt-get install python-coverage python-dev python-nose \

                     python-xattr python-eventlet \

                     python-greenletpython-pastedeploy \

                        python-netifaces python-pip python-dnspython\                   python-mock

2）          使用迴環裝置儲存

1》  使用迴環裝置作為儲存

1.     sudomkdir /srv

2.     sudotruncate -s 1GB /srv/swift-disk

3.     sudomkfs.xfs /srv/swift-disk

修改truncate命令中指定的大小以根據需要建立更大或更小的分割槽

2》  編輯修改分割槽表/etc/fstab並新增（sudo gedit /etc/fstab）:

/srv/swift-disk /mnt/sda1 xfs loop,noatime,nodiratime,nobarrier,logbufs=80 0

3》  建立掛載點和連結

1.     sudomkdir /mnt/sda1

2.     sudomount /mnt/sda1

3.     sudomkdir /mnt/sda1/1 /mnt/sda1/2 /mnt/sda1/3 /mnt/sda1/4

4.     sudochown ${USER}:${USER} /mnt/sda1/*

5.     forx in {1..4}; do sudo ln -s /mnt/sda1/$x /srv/$x; done

6.     sudomkdir -p /srv/1/node/sda1 /srv/1/node/sda5 \

                       /srv/2/node/sda2 /srv/2/node/sda6\

           /srv/3/node/sda3 /srv/3/node/sda7 \

/srv/4/node/sda4 /srv/4/node/sda8 \

/var/run/swift

7.     sudochown -R ${USER}:${USER} /var/run/swift

8.     forx in {1..4}; do sudo chown -R ${USER}:${USER} /srv/$x/; done

4》  CommonPost-Device Setup

新增下面幾行到/etc/rc.local中（在exit 0 之前）：

1.     mkdir-p /var/cache/swift /var/cache/swift2 /var/cache/swift3 /var/cache/swift4

2.     chown<your-user-name>:<your-group-name> /var/cache/swift*

3.     mkdir-p /var/run/swift

4.     chown<your-user-name>:<your-group-name> /var/run/swift

3) 獲取程式碼

   1》下載python-swiftclient程式碼

   2》編譯並安裝python-swiftclient

1.     cd$HOME/python-swiftclient; sudo python setup.py develop; cd –

   3》下載swift的程式碼

4》編譯並安裝swift

注意：在Ubuntu14.04中按照官方文件的安裝方式有些包是安裝不上的，因為包之間的版本衝突

1.     cd $Home/swift

2.     sudo apt-get purgepython-setuptools

3.     sudo apt-get install python-pbr

4.     sudo pip install -rrequirements.txt

5.     sudo pip install -rtest-requirements.txt

6.     sudo python setup.py develop;cd –

4) 安裝rsync

1》     建立/etc/rsyncd.conf:

1.     sudocp $HOME/swift/doc/saio/rsyncd.conf /etc/

2.     sudosed -i "s/<your-user-name>/${USER}/" /etc/rsyncd.conf

  預設rsyncd.conf檔案內容如下，用來修復上面的修改

uid = <your-user-name>

gid = <your-user-name>

log file = /var/log/rsyncd.log

pid file = /var/run/rsyncd.pid

address = 127.0.0.1

[account6012]

max connections = 25

path = /srv/1/node/

read only = false

lock file = /var/lock/account6012.lock

[account6022]

max connections = 25

path = /srv/2/node/

read only = false

lock file = /var/lock/account6022.lock

[account6032]

max connections = 25

path = /srv/3/node/

read only = false

lock file = /var/lock/account6032.lock

[account6042]

max connections = 25

path = /srv/4/node/

read only = false

lock file = /var/lock/account6042.lock

[container6011]

max connections = 25

path = /srv/1/node/

read only = false

lock file = /var/lock/container6011.lock

[container6021]

max connections = 25

path = /srv/2/node/

read only = false

lock file = /var/lock/container6021.lock

[container6031]

max connections = 25

path = /srv/3/node/

read only = false

lock file = /var/lock/container6031.lock

[container6041]

max connections = 25

path = /srv/4/node/

read only = false

lock file = /var/lock/container6041.lock

[object6010]

max connections = 25

path = /srv/1/node/

read only = false

lock file = /var/lock/object6010.lock

[object6020]

max connections = 25

path = /srv/2/node/

read only = false

lock file = /var/lock/object6020.lock

[object6030]

max connections = 25

path = /srv/3/node/

read only = false

lock file = /var/lock/object6030.lock

[object6040]

max connections = 25

path = /srv/4/node/

read only = false

lock file = /var/lock/object6040.lock

再次提醒讀者注意這裡和接下來所出現的所有IP地址

2》     在Ubuntu，修改/etc/default/rsync中的下面一行

1.     RSYNC_ENABLE=true

3》     啟動rsync

1.     sudoservice rsync restart

4》     驗證rsync是不是接受了所有的連線

1.     rsyncrsync://[email protected]/

   執行上述命令，應該會看到

account6012

account6022

account6032

account6042

container6011

container6021

container6031

container6041

object6010

object6020

object6030

object6040

5) 啟動memcached

sudo serviceMemcached start

tempauth中介軟體在memcached中儲存令牌。如果memcached是沒有執行，令牌不能被驗證，就無法使用swift

(可選) 啟動rsyslog,為swift建立獨立的日誌

1》 安裝swift rsyslog的配置

1.  sudo cp$HOME/swift/doc/saio/rsyslog.d/10-swift.conf /etc/rsyslog.d/

檢視該conf檔案以確定是否要將日誌獨立出來，以及是否需要每小時處理統計資訊的日誌。為方便起見，我們提供以下預設內容：

# Uncomment thefollowing to have a log containing all logs together

#local1,local2,local3,local4,local5.*   /var/log/swift/all.log

# Uncomment thefollowing to have hourly proxy logs for stats processing

#$templateHourlyProxyLog,"/var/log/swift/hourly/%$YEAR%%$MONTH%%$DAY%%$HOUR%"

#local1.*;local1.!notice?HourlyProxyLog

local1.*;local1.!notice /var/log/swift/proxy.log

local1.notice           /var/log/swift/proxy.error

local1.*                ~

local2.*;local2.!notice /var/log/swift/storage1.log

local2.notice          /var/log/swift/storage1.error

local2.*                ~

local3.*;local3.!notice /var/log/swift/storage2.log

local3.notice           /var/log/swift/storage2.error

local3.*                ~

local4.*;local4.!notice /var/log/swift/storage3.log

local4.notice          /var/log/swift/storage3.error

local4.*                ~

local5.*;local5.!notice /var/log/swift/storage4.log

local5.notice          /var/log/swift/storage4.error

local5.*                ~

local6.*;local6.!notice /var/log/swift/expirer.log

local6.notice          /var/log/swift/expirer.error

local6.*                ~

2》 編輯/etc/rsyslog.conf 並進行以下修改（在“GLOBAL DIRECTIVES”中）

$PrivDropToGroup adm

3》 如果使用的是hourly logs則執行下面的

sudo mkdir -p /var/log/swift/hourly

否則執行

  sudomkdir -p /var/log/swift

4》 建立日誌目錄，啟動syslog

1.  sudo chown -Rsyslog.adm /var/log/swift

2.  sudo chmod -R g+w /var/log/swift

3.  sudo service rsyslog restart

6) 配置每一個節點

執行以下步驟時，請務必檢視配置檔案是否與示例一致，注意ip和埠號

1》（可選）刪除已經存在的swift目錄

1.  sudo rm -rf/etc/swift

2》往/etc/swift中新增配置檔案

1.  cd$HOME/swift/doc; sudo cp -r saio/swift /etc/swift; cd –

2.  sudo chown -R${USER}:${USER} /etc/swift

3》在swift配置檔案中更新<your-user-name>引用

1.  find /etc/swift/-name \*.conf | xargs sudo sed -i "s/<your-user-name>/${USER}/"

通過執行上述命令提供的配置檔案的內容如下：

1./etc/swift/swift.conf

[swift-hash]

# random uniquestrings that can never change (DO NOT LOSE)

# Use only printablechars (python -c "import string; print(string.printable)")

swift_hash_path_prefix = changeme

swift_hash_path_suffix = changeme

[storage-policy:0]

name = gold

policy_type = replication

default = yes

[storage-policy:1]

name = silver

policy_type = replication

[storage-policy:2]

name = ec42

policy_type = erasure_coding

ec_type = liberasurecode_rs_vand

ec_num_data_fragments =4

ec_num_parity_fragments= 2

2./etc/swift/proxy-server.conf

[DEFAULT]

bind_ip = 127.0.0.1

bind_port = 8080

workers = 1

user =<your-user-name>

log_facility =LOG_LOCAL1

eventlet_debug = true

[pipeline:main]

# Yes, proxy-loggingappears twice. This is so that

#middleware-originated requests get logged too.

pipeline = catch_errorsgatekeeper healthcheck proxy-logging cache bulk tempurl ratelimit crossdomaincontainer_sync tempauth staticweb copy container-quotas account-quotas slo dloversioned_writes proxy-logging proxy-server

[filter:catch_errors]

use = egg:swift#catch_errors

[filter:healthcheck]

use = egg:swift#healthcheck

[filter:proxy-logging]

use = egg:swift#proxy_logging

[filter:bulk]

use = egg:swift#bulk

[filter:ratelimit]

use = egg:swift#ratelimit

[filter:crossdomain]

use = egg:swift#crossdomain

[filter:dlo]

use = egg:swift#dlo

[filter:slo]

use = egg:swift#slo

[filter:container_sync]

use = egg:swift#container_sync

current =//saio/saio_endpoint

[filter:tempurl]

use = egg:swift#tempurl

[filter:tempauth]

use = egg:swift#tempauth

user_admin_admin =admin .admin .reseller_admin

user_test_tester =testing .admin

user_test2_tester2 =testing2 .admin

user_test_tester3 =testing3

[filter:staticweb]

use = egg:swift#staticweb

[filter:account-quotas]

use = egg:swift#account_quotas

[filter:container-quotas]

use = egg:swift#container_quotas

[filter:cache]

use = egg:swift#memcache

[filter:gatekeeper]

use = egg:swift#gatekeeper

[filter:versioned_writes]

use = egg:swift#versioned_writes

allow_versioned_writes= true

[filter:copy]

use = egg:swift#copy

[app:proxy-server]

use = egg:swift#proxy

allow_account_management= true

account_autocreate = true

3./etc/swift/object-expirer.conf

[DEFAULT]

# swift_dir =/etc/swift

user =<your-user-name>

# You can specifydefault log routing here if you want:

log_name =object-expirer

log_facility =LOG_LOCAL6

log_level = INFO

#log_address =/dev/log

#

# comma separatedlist of functions to call to setup custom log handlers.

# functions getpassed: conf, name, log_to_console, log_route, fmt, logger,

# adapted_logger

# log_custom_handlers=

#

# If set,log_udp_host will override log_address

# log_udp_host =

# log_udp_port = 514

#

# You can enableStatsD logging here:

# log_statsd_host =

# log_statsd_port =8125

#log_statsd_default_sample_rate = 1.0

#log_statsd_sample_rate_factor = 1.0

#log_statsd_metric_prefix =

[object-expirer]

interval = 300

# auto_create_account_prefix= .

# report_interval =300

# concurrency is thelevel of concurrency o use to do the work, this value

# must be set to atleast 1

# concurrency = 1

# processes is howmany parts to divide the work into, one part per process

#   that will be doing the work

# processes set 0means that a single process will be doing all the work

# processes can alsobe specified on the command line and will override the

#   config value

# processes = 0

# process is which ofthe parts a particular process will work on

# process can also bespecified on the command line and will override the config

#   value

# process is"zero based", if you want to use 3 processes, you should run

#  processes with process set to 0, 1, and 2

# process = 0

[pipeline:main]

pipeline = catch_errorscache proxy-server

[app:proxy-server]

use = egg:swift#proxy

# Seeproxy-server.conf-sample for options

[filter:cache]

use = egg:swift#memcache

# Seeproxy-server.conf-sample for options

[filter:catch_errors]

use = egg:swift#catch_errors

# Seeproxy-server.conf-sample for options

4./etc/swift/container-reconciler.conf

[DEFAULT]

# swift_dir =/etc/swift

user =<your-user-name>

# You can specifydefault log routing here if you want:

# log_name = swift

# log_facility =LOG_LOCAL0

# log_level = INFO

# log_address =/dev/log

#

# comma separatedlist of functions to call to setup custom log handlers.

# functions getpassed: conf, name, log_to_console, log_route, fmt, logger,

# adapted_logger

# log_custom_handlers=

#

# If set,log_udp_host will override log_address

# log_udp_host =

# log_udp_port = 514

#

# You can enableStatsD logging here:

# log_statsd_host =

# log_statsd_port =8125

#log_statsd_default_sample_rate = 1.0

#log_statsd_sample_rate_factor = 1.0

#log_statsd_metric_prefix =

[container-reconciler]

# reclaim_age =604800

# interval = 300

# request_tries = 3

[pipeline:main]

pipeline = catch_errorsproxy-logging cache proxy-server

[app:proxy-server]

use = egg:swift#proxy

# Seeproxy-server.conf-sample for options

[filter:cache]

use = egg:swift#memcache

# Seeproxy-server.conf-sample for options

[filter:proxy-logging]

use = egg:swift#proxy_logging

[filter:catch_errors]

use = egg:swift#catch_errors

# Seeproxy-server.conf-sample for options

5./etc/swift/container-sync-realms.conf

[saio]

key = changeme

key2 = changeme

cluster_saio_endpoint =http://127.0.0.1:8080/v1/

6./etc/swift/account-server/1.conf

[DEFAULT]

devices = /srv/1/node

mount_check = false

disable_fallocate = true

bind_ip = 127.0.0.1

bind_port = 6012

workers = 1

user =<your-user-name>

log_facility =LOG_LOCAL2

recon_cache_path =/var/cache/swift

eventlet_debug = true

[pipeline:main]

pipeline = reconaccount-server

[app:account-server]

use = egg:swift#account

[filter:recon]

use = egg:swift#recon

[account-replicator]

rsync_module ={replication_ip}::account{replication_port}

[account-auditor]

[account-reaper]

7./etc/swift/container-server/1.conf

[DEFAULT]

devices = /srv/1/node

mount_check = false

disable_fallocate = true

bind_ip = 127.0.0.1

bind_port = 6011

workers = 1

user =<your-user-name>

log_facility =LOG_LOCAL2

recon_cache_path =/var/cache/swift

eventlet_debug = true

[pipeline:main]

pipeline = reconcontainer-server

[app:container-server]

use = egg:swift#container

[filter:recon]

use = egg:swift#recon

[container-replicator]

rsync_module ={replication_ip}::container{replication_port}

[container-updater]

[container-auditor]

[container-sync]

8./etc/swift/object-server/1.conf

[DEFAULT]

devices = /srv/1/node

mount_check = false

disable_fallocate = true

bind_ip = 127.0.0.1

bind_port = 6010

workers = 1

user =<your-user-name>

log_facility =LOG_LOCAL2

recon_cache_path =/var/cache/swift

eventlet_debug = true

[pipeline:main]

pipeline = reconobject-server

[app:object-server]

use = egg:swift#object

[filter:recon]

use = egg:swift#recon

[object-replicator]

rsync_module ={replication_ip}::object{replication_port}

[object-reconstructor]

[object-updater]

[object-auditor]

9./etc/swift/account-server/2.conf

[DEFAULT]

devices = /srv/2/node

mount_check = false

disable_fallocate = true

bind_ip = 127.0.0.1

bind_port = 6022

workers = 1

user =<your-user-name>

log_facility =LOG_LOCAL3

recon_cache_path =/var/cache/swift2

eventlet_debug = true

[pipeline:main]

pipeline = reconaccount-server

[app:account-server]

use = egg:swift#account

[filter:recon]

use = egg:swift#recon

[account-replicator]

rsync_module ={replication_ip}::account{replication_port}

[account-auditor]

[account-reaper]

10./etc/swift/container-server/2.conf

[DEFAULT]

相關推薦