目錄

一、準備工作

地址規劃

以下步驟，如未宣告節點，即為每個節點都要操作

在三臺伺服器上都配置好 /etc/hosts 檔案

# cat >> /etc/hosts << EOF
172.240.24.188 master188  master188.qufujin.top 
172.240.24.111 node111    node111.qufujin.top 
172.240.24.112 node112    node112.qufujin.top 
EOF
 

ssh 建立信任關係

# ssh-keygen -t rsa

#!/bin/bash
ip=(172.240.24.111 \
    172.240.24.112 \
    172.240.24.113)
pass="[email protected]"
port="1804"

yum install -y expect

for i in ${ip[@]}
do
    expect -c "   
    spawn ssh-copy-id -p${port} -i /root/.ssh/id_rsa.pub [email protected]${i}
        expect {   
            \"*yes/no*\" {send \"yes\r\"; exp_continue}   
            \"*password*\" {send \"${pass}\r\"; exp_continue}   
            \"*Password*\" {send \"${pass}\r\";}   
        } "
done
 

# bash ssh.sh

關閉防火牆和 selinux

# systemctl stop firewalld && systemctl disable firewalld
# sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config

關閉各節點swap (註釋/etc/fstab檔案裡swap相關的行)

# sed -i '/swap/ [email protected]^\(.*\)[email protected]#\[email protected]' /etc/fstab

配置各節點系統核心引數使流過網橋的流量也進入 iptables/netfilter 框架中

# cat > /etc/sysctl.d/kubernetes.conf << EOF
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
EOF
# modprobe br_netfilter && sysctl -p /etc/sysctl.d/kubernetes.conf

重啟生效（修改 SElinux 後必須重啟）

# reboot

二、部署Kubernetes叢集

以下步驟，如未宣告節點，即為每個節點都要操作

安裝 Docker

# yum install -y epel-release yum-utils device-mapper-persistent-data lvm2 wget
# yum-config-manager --add-repo http://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
# yum install -y docker-ce
# curl -sSL https://get.daocloud.io/daotools/set_mirror.sh | sh -s http://bc437cce.m.daocloud.io
# systemctl enable docker && systemctl restart docker

安裝 kubeadm、kubelet、kubeadm

# cat >>/etc/yum.repos.d/kubernetes.repo <<EOF
[kubernetes]
name = Kubernetes Repo
baseurl = https://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64/
enabled = 1
gpgcheck = 1	
gpgkey = https://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
EOF
# yum install -y kubeadm-1.11.3-0.x86_64 kubelet-1.11.3-0.x86_64 kubectl
# systemctl enable kubelet && systemctl restart kubelet

因為 Google 提供映象的站點在牆外，因此需要在國內下載映象，然後重新打上 kubeadm 初始化時可以識別的標籤

# cat k8s_images.sh 
#!/bin/bash
images=(kube-proxy-amd64:v1.11.3 \
        kube-scheduler-amd64:v1.11.3 \
        kube-controller-manager-amd64:v1.11.3 \
        kube-apiserver-amd64:v1.11.3 \
        etcd-amd64:3.2.18 \
        coredns:1.1.3 \
        pause:3.1)
for imageName in ${images[@]}
do
    docker pull registry.cn-hangzhou.aliyuncs.com/google_containers/$imageName
    docker tag registry.cn-hangzhou.aliyuncs.com/google_containers/$imageName k8s.gcr.io/$imageName
    docker rmi registry.cn-hangzhou.aliyuncs.com/google_containers/$imageName
done

在 master188 上完成初始化

# kubeadm init \
--kubernetes-version=v1.11.3 \
 --pod-network-cidr=10.244.0.0/16 \
--service-cidr=10.96.0.0/12 \
--apiserver-advertise-address=172.240.24.188

 kubeadm init 選項說明

# 選項說明：

# kubeadm init --help
	--apiserver-advertise-address 	\\apiserver向外公告自己的地址是什麼，default：0.0.0.0
	--apiserver-bind-port 	\\apiserver向外監聽的埠，default：6443
	--cert-dir STRING 	\\儲存證書的相關目錄，default "/etc/kubernetes/pki"
	--config 	\\配置檔案
	--ignore-preflight-errors  \\在預檢查的時候可以忽略一些錯誤，比如swap
	--kubernetes-version   \\kubernetes的版本
	--pod-network-cidr     \\pod所使用的網路
	--service-cidr         \\service的網路

.......................................................................

You can now join any number of machines by running the following on each node
as root:

  kubeadm join 172.240.24.188:6443 --token aye96c.hdo6xzlskgmk4anz --discovery-token-ca-cert-hash sha256:b2ff321b46be33766a73191f31f6401eccac455eac9faeb6bf4c30a9e8407923

初始化成功後會生成一行類似於令牌的東西，儲存下來，等下在 各 node 上執行（node111,node112），將各 node 加入叢集

# kubeadm join 172.240.24.188:6443 --token aye96c.hdo6xzlskgmk4anz --discovery-token-ca-cert-hash sha256:b2ff321b46be33766a73191f31f6401eccac455eac9faeb6bf4c30a9e8407923

在master上執行後面的所有操作

執行以下命令進行 kubelet 的 kubeconfig 配置，以便讓當前使用者使用叢集

$ mkdir -p $HOME/.kube
$ sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config 
$ sudo chown $(id -u):$(id -g) $HOME/.kube/config

配置 kubectl 命令補全 。注：kubectl：apiserver的命令列客戶端

# yum install -y bash-completion
# source /usr/share/bash-completion/bash_completion
# echo 'source <(kubectl completion bash)' >> /etc/profile
# source /etc/profile

如果是kubenetes 1.7以上版本，只需要執行這條命令就OK了，會自動獲取線上的部署清單，基於此清單下載映象，啟動並部署flannel

# kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml

檢視叢集中各元件狀態資訊，此處沒有apiserver，但沒事。因為如果apiserver不健康，那麼這個請求也發不過去

# kubectl get componentstatuses 
NAME                 STATUS    MESSAGE              ERROR
scheduler            Healthy   ok                   
controller-manager   Healthy   ok                   
etcd-0               Healthy   {"health": "true"}   

檢視叢集中各節點的狀態

# kubectl get nodes
NAME                    STATUS   ROLES    AGE   VERSION
master188.qufujin.top   Ready    master   11m   v1.11.3
node111.qufujin.top     Ready    <none>   8m    v1.11.3
node112.qufujin.top     Ready    <none>   8m    v1.11.3

檢視叢集資訊

# kubectl cluster-info 
Kubernetes master is running at https://172.240.24.188:6443
KubeDNS is running at https://172.240.24.188:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy

To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.