一、ceph & openstack可整合部分

• cinder
• glance
• nova

二、ceph&openstack cinder整合

功能支援：

• ceph rbd作為cinder儲存後端，完整的實現了cinder的介面

整合步驟：

• 在ceph中建立池供openstack使用

ceph osd pool create dk-pool 2048 2048

• ceph中建立相關的賬號，並設定許可權,dk-cinder 用於訪問dk-pool

ceph auth get-or-create client.dk-cinder mon 'allow r'
 
 osd 'allow class-read object_prefix rbd_children, allow rwx pool=dk-pool'

• 同步ceph配置到openstack節點中(openstack將使用此配置訪問ceph叢集)

ssh {your-openstack-server} sudo tee /etc/ceph/ceph.conf </etc/ceph/ceph.conf

• openstack主機安裝相關的軟體包

sudo apt-get install python-rbd
sudo apt-get install ceph-common

• 同步keyring檔案

# 將dk-cinder user的keyring拷貝到cinder volume節點,並更改相應的許可權.
ceph auth get-or-create client.dk-cinder | ssh {your-openstack-server}  sudo tee /etc/ceph/ceph.client.dk-cinder.keyring
ssh {your-openstack-server}  sudo chown cinder:cinder /etc/ceph/ceph.client.dk-cinder.keyring (devstack環境中不需要設定使用者組)

• nova認證dk-cinder

ceph auth get-key client.dk-cinder | ssh {your-compute-node} sudo tee /etc/ceph/client.dk-cinder.key

uuidgen
>   70cafbfb-3f5e-48c5-8acc-32858cb0814d

cat > secret.xml <<EOF
<secret ephemeral='no' private='no'>
  <uuid> 70cafbfb-3f5e-48c5-8acc-32858cb0814d</uuid>
  <usage type='ceph'>
    <name>client.dk-cinder secret</name>
  </usage>
</secret>
EOF

sudo virsh secret-define --file secret.xml
sudo virsh secret-set-value --secret  70cafbfb-3f5e-48c5-8acc-32858cb0814d --base64 $(cat client.dk-cinder.key) && rm client.dk-cinder.key secret.xml

- 設定cinder.conf（/etc/cinder/cinder.conf）

backend name （rbd2）可隨意設定，保持統一就行

cat cinder.conf
[DEFAULT]
...
enabled_backends = rbd2
...
[rbd2]
volume_driver = cinder.volume.drivers.rbd.RBDDriver
rados_connect_timeout = -1
rados_connection_interval = 5
rados_connection_retries = 3
rdb_ceph_conf = /etc/ceph/ceph.conf
rbd_cluster_name = ceph
rbd_flatten_volume_from_snapshot = True
rbd_max_clone_depth = 5
rbd_pool = dk-pool
rbd_user = dk-cinder
rbd_secret_uuid = 70cafbfb-3f5e-48c5-8acc-32858cb0814d
rbd_store_chunk_size = 4
volume_backend_name = rbd2

• 重啟cinder服務，檢視cinder list

整合驗證:

• 建立卷型別

• 設定volume type

• 建立卷

• 檢視卷資訊

• ceph ls dk-pool

openstack平臺環境搭建

部署步驟:

• Add Stack User

$ sudo useradd -s /bin/bash -d /opt/stack -m stack
$ echo "stack ALL=(ALL) NOPASSWD: ALL" | sudo tee /etc/sudoers.d/stack
$ sudo su - stack

• Download DevStack

$ git clone https://git.openstack.org/openstack-dev/devstack
$ cd devstack

• Create a local.conf

[[local|localrc]]
ADMIN_PASSWORD=secret
DATABASE_PASSWORD=$ADMIN_PASSWORD
RABBIT_PASSWORD=$ADMIN_PASSWORD
SERVICE_PASSWORD=$ADMIN_PASSWORD

• Start the install

./stack.sh

依賴問題:

• 依賴及Python庫版本問題，根據錯誤資訊修改替換即可

• etcd-v3.1.10-linux-amd64.tar.gz 無法自動下載成功，手動從錯誤處的網址下載，放在/opt/stack/devstack/files 目錄中
  （如果提示MD5校驗失敗，手動刪除md5記錄檔案）

• mysql安裝失敗: purse autoremove autoclean 後重新安裝

• 配置源：

vi ~/.pip/pip.conf
[global]
index-url=http://mirrors.aliyun.com/pypi/simple/

[install]

trusted-host=mirrors.aliyun.com

vi /etc/apt/sources.lis

# deb cdrom:[Ubuntu 16.04 LTS _Xenial Xerus_ - Release amd64 (20160420.1)]/ xenial main restricted
deb-src http://archive.ubuntu.com/ubuntu xenial main restricted #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial main restricted multiverse universe #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted multiverse universe #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates universe
deb http://mirrors.aliyun.com/ubuntu/ xenial multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse #Added by software-properties
deb http://archive.canonical.com/ubuntu xenial partner
deb-src http://archive.canonical.com/ubuntu xenial partner
deb http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted multiverse universe #Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-security universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-security multiverse