|NO.Z.00265|——————————|^^ 部署 ^^|——|KuberNetes&中介軟體容器化及helm.V12|------------------------------------------|中介軟體.v01|RabbitMQ|部署|

一、RabbitMQ概述

### --- RabbitMQ概述

~~~     相比redis：RabbitMQ是支援服務發現的，可以利用k8s的服務發現機制；然後自動的配置叢集，
~~~     說明即使沒有後端儲存，也是可以執行在k8s叢集中的。
~~~     而且RabbitMQ擴容和縮容是非常簡單的一件事，因為它用的是k8s的服務發現機制，查詢符合條件的叢集節點。自動的加入到叢集當中。
~~~     # 建議使用StatefulSet來安裝RabbitMQ

### --- 官方地址：

~~~     https://github.com/dotbalo/k8s/tree/master/k8s-rabbitmq-cluster

一、RabbitMQ安裝

### --- 拉取RabbitMQ的程式包

[root@k8s-master01 RabbitMQ]# git clone https://github.com/dotbalo/k8s.git
Cloning into 'k8s'...
remote: Enumerating objects: 683, done.
remote: Counting objects: 100% (51/51), done.
remote: Compressing objects: 100% (45/45), done.
remote: Total 683 (delta 18), reused 21 (delta 4), pack-reused 632
Receiving objects: 100% (683/683), 5.02 MiB | 975.00 KiB/s, done.
Resolving deltas: 100% (294/294), done.

二、建立rabbitmq.namespace

### --- 建立namespace

[root@k8s-master01 rabbit-cluster]# kubectl create ns public-service
namespace/public-service created

三、建立rabbitmq-configmap.yaml配置檔案

### --- 建立rabbitmq-configmap-yaml檔案
~~~     模板地址：https://github.com/dotbalo/k8s/blob/master/k8s-rabbitmq-cluster/rabbitmq-configmap.yaml

[root@k8s-master01 rabbit-cluster]# vim rabbitmq-configmap.yaml
kind: ConfigMap
apiVersion: v1
metadata:
  name: rmq-cluster-config
  namespace: public-service
  labels:
    addonmanager.kubernetes.io/mode: Reconcile
data:
    enabled_plugins: |
      [rabbitmq_management,rabbitmq_peer_discovery_k8s].
    rabbitmq.conf: |
      loopback_users.guest = false
      ## Clustering
      cluster_formation.peer_discovery_backend = rabbit_peer_discovery_k8s
      cluster_formation.k8s.host = kubernetes.default.svc.cluster.local
      cluster_formation.k8s.address_type = hostname
      #################################################
      # public-service is rabbitmq-cluster's namespace#
      #################################################
      cluster_formation.k8s.hostname_suffix = .rmq-cluster.public-service.svc.cluster.local
      cluster_formation.node_cleanup.interval = 10
      cluster_formation.node_cleanup.only_log_warning = true
      cluster_partition_handling = autoheal
      ## queue master locator
      queue_master_locator=min-masters

### --- 注：

  name: rmq-cluster-config                              // 建立了一個configmap，它的名稱是rmq-cluster-config
  namespace: public-service                             // namespace
data:                                                   // 它會建立2個檔案
    enabled_plugins: |                                  // 第一個，它需要開啟的外掛
      [rabbitmq_management,rabbitmq_peer_discovery_k8s].// 使用這個外掛自動發現這個叢集有多少個redis，然後根據自動發現加入叢集或者縮容叢集
    rabbitmq.conf: |
      loopback_users.guest = false                      // 第二個，叢集的配置檔案；根據這些配置來實現自動發現

四、建立rabbitmq-configmap

### --- 建立configmap

[root@k8s-master01 rabbit-cluster]# kubectl create -f rabbitmq-configmap.yaml 
configmap/rmq-cluster-config created

五、建立rabbitmq-secret.yaml配置檔案

### --- 編寫secret配置檔案
~~~     注：儲存的是一些它的配置資訊；賬號密碼url等資訊

[root@k8s-master01 rabbit-cluster]# vim rabbitmq-secret.yaml 
kind: Secret
apiVersion: v1
metadata:
  name: rmq-cluster-secret
  namespace: public-service
stringData:
  cookie: ERLANG_COOKIE
  password: RABBITMQ_PASS
  url: amqp://RABBITMQ_USER:RABBITMQ_PASS@rmq-cluster-balancer
  username: RABBITMQ_USER
type: Opaque

### --- 注：service，反代到另一個rabbitmq節點

  name: rmq-cluster-secret
  namespace: public-service
  cookie: ERLANG_COOKIE
  password: RABBITMQ_PASS
  url: amqp://RABBITMQ_USER:RABBITMQ_PASS@rmq-cluster-balancer  
  username: RABBITMQ_USER

六、建立rabbitmq-secret

### --- 建立secret

[root@k8s-master01 rabbit-cluster]# kubectl create -f rabbitmq-secret.yaml 
secret/rmq-cluster-secret created

七、建立rabbitmq-service.yaml

### --- 編寫service的yaml檔案；建立的是2個service，可以寫在一個配置檔案中

[root@k8s-master01 rabbit-cluster]# vim rabbitmq-svc.yaml
kind: Service
apiVersion: v1
metadata:
  labels:
    app: rmq-cluster
  name: rmq-cluster
  namespace: public-service
spec:
  clusterIP: None
  ports:
  - name: amqp
    port: 5672
    targetPort: 5672
  selector:
    app: rmq-cluster
---
kind: Service
apiVersion: v1
metadata:
  labels:
    app: rmq-cluster
    type: LoadBalancer
  name: rmq-cluster-balancer
  namespace: public-service
spec:
  ports:
  - name: http
    port: 15672
    protocol: TCP
    targetPort: 15672
  - name: amqp
    port: 5672
    protocol: TCP
    targetPort: 5672
  selector:
    app: rmq-cluster
  type: NodePort        # 可以更改成ClusterIP ingress配置一個域名訪問

八、建立rabbitmq-service

### --- 建立service

[root@k8s-master01 rabbit-cluster]# kubectl create -f rabbitmq-svc.yaml 
service/rmq-cluster created
service/rmq-cluster-balancer created

### --- 檢視建立的service
~~~     注：建立了2個service
~~~     第一個：無頭service，是用於rabbitmq通訊用的
~~~     第二個：rmq-cluster-balancer是客戶端連線rabbitmq用的

[root@k8s-master01 rabbit-cluster]# kubectl get svc -n public-service
NAME                   TYPE        CLUSTER-IP      EXTERNAL-IP   PORT(S)                          AGE
rmq-cluster            ClusterIP   None            <none>        5672/TCP                         32m
rmq-cluster-balancer   NodePort    10.101.215.84   <none>        15672:31549/TCP,5672:31578/TCP   32m

九、建立rabbitmq-rbac.yaml

### --- 編寫rbac的yaml檔案

[root@k8s-master01 rabbit-cluster]# vim rabbitmq-rbac.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
  name: rmq-cluster
  namespace: public-service
---
kind: Role
apiVersion: rbac.authorization.k8s.io/v1beta1
metadata:
  name: rmq-cluster
  namespace: public-service
rules:
  - apiGroups:
      - ""
    resources:
      - endpoints
    verbs:
      - get
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1beta1
metadata:
  name: rmq-cluster
  namespace: public-service
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: Role
  name: rmq-cluster
subjects:
- kind: ServiceAccount
  name: rmq-cluster
  namespace: public-service

十、建立rabbitmq-rbac

### --- 建立rbac

[root@k8s-master01 rabbit-cluster]# kubectl create -f rabbitmq-rbac.yaml 
serviceaccount/rmq-cluster created          // rbac的名稱是：rmq-cluster，後面實驗需要用到
role.rbac.authorization.k8s.io/rmq-cluster created
rolebinding.rbac.authorization.k8s.io/rmq-cluster created

十一、建立rmq-cluster-StatefulSet.yaml

### --- 建立rmq-cluster

[root@k8s-master01 rabbit-cluster]# vim rabbitmq-cluster-sts.yaml
kind: StatefulSet
apiVersion: apps/v1
metadata:
  labels:
    app: rmq-cluster
  name: rmq-cluster
  namespace: public-service
spec:
  replicas: 3
  selector:
    matchLabels:
      app: rmq-cluster
  serviceName: rmq-cluster
  template:
    metadata:
      labels:
        app: rmq-cluster
    spec:
      containers:
      - args:
        - -c
        - cp -v /etc/rabbitmq/rabbitmq.conf ${RABBITMQ_CONFIG_FILE}; exec docker-entrypoint.sh
          rabbitmq-server
        command:
        - sh
        env:
        - name: RABBITMQ_DEFAULT_USER
          valueFrom:
            secretKeyRef:
              key: username
              name: rmq-cluster-secret
        - name: RABBITMQ_DEFAULT_PASS
          valueFrom:
            secretKeyRef:
              key: password
              name: rmq-cluster-secret
        - name: RABBITMQ_ERLANG_COOKIE
          valueFrom:
            secretKeyRef:
              key: cookie
              name: rmq-cluster-secret
        - name: K8S_SERVICE_NAME
          value: rmq-cluster
        - name: POD_IP
          valueFrom:
            fieldRef:
              fieldPath: status.podIP
        - name: POD_NAME
          valueFrom:
            fieldRef:
              fieldPath: metadata.name
        - name: POD_NAMESPACE
          valueFrom:
            fieldRef:
              fieldPath: metadata.namespace
        - name: RABBITMQ_USE_LONGNAME
          value: "true"
        - name: RABBITMQ_NODENAME
          value: rabbit@$(POD_NAME).rmq-cluster.$(POD_NAMESPACE).svc.cluster.local
        - name: RABBITMQ_CONFIG_FILE
          value: /var/lib/rabbitmq/rabbitmq.conf
        image: rabbitmq:3.8.3-management
        imagePullPolicy: IfNotPresent
        livenessProbe:
          exec:
            command:
            - rabbitmqctl
            - status
          initialDelaySeconds: 30
          timeoutSeconds: 10
        name: rabbitmq
        ports:
        - containerPort: 15672
          name: http
          protocol: TCP
        - containerPort: 5672
          name: amqp
          protocol: TCP
        readinessProbe:
          exec:
            command:
            - rabbitmqctl
            - status
          initialDelaySeconds: 10
          timeoutSeconds: 10
        volumeMounts:
        - mountPath: /etc/rabbitmq
          name: config-volume
          readOnly: false
        - mountPath: /var/lib/rabbitmq
          name: rabbitmq-storage
          readOnly: false
      serviceAccountName: rmq-cluster
      terminationGracePeriodSeconds: 30
      volumes:
      - configMap:
          items:
          - key: rabbitmq.conf
            path: rabbitmq.conf
          - key: enabled_plugins
            path: enabled_plugins
          name: rmq-cluster-config
        name: config-volume
      - name: rabbitmq-storage
        emptyDir: {}

### --- 注：

kind: StatefulSet
apiVersion: apps/v1                             // apps/v1betal已經不用了 ，更改為apps/v1
  replicas: 3                                   // 副本數為3
        - cp -v /etc/rabbitmq/rabbitmq.conf ${RABBITMQ_CONFIG_FILE}; exec docker-entrypoint.sh    // 配置是通過configmap掛載進來的，拷貝到/var/lib/rabbitmq/rabbitmq.conf這個路徑下
        - name: RABBITMQ_DEFAULT_USER           // 配置了賬號密碼
              key: cookie                       // cookie配置
              name: rmq-cluster-secret
        - name: K8S_SERVICE_NAME                // service name
          value: /var/lib/rabbitmq/rabbitmq.con // 前面定義的變數；cp -v定義的變數
              name: rmq-cluster-secret          // rmq-cluster-secret和secret名稱保持一致
      serviceAccountName: rmq-cluster           // 就是剛才建立的service，它是有叢集的檢視許可權的。可以檢視到當前有多少個RabbitMQ例項，可以建立成叢集
        name: config-volume
       -name：rabbitmq-storage
        emptyDir: {}                            // 若需要持久化資料的情況下，可以更改為後端儲存即可

十二、建立rmq-cluster-StatefulSet

### --- 檢視rmq-cluster-secret.yaml    

[root@k8s-master01 ~]# kubectl get secret -n public-service rmq-cluster-secret -oyaml
apiVersion: v1
data:
  cookie: RVJMQU5HX0NPT0tJRQ==
  password: UkFCQklUTVFfUEFTUw==        // 密碼
  url: YW1xcDovL1JBQkJJVE1RX1VTRVI6UkFCQklUTVFfUEFTU0BybXEtY2x1c3Rlci1iYWxhbmNlcg==
  username: UkFCQklUTVFfVVNFUg==        // 賬號
    manager: kubectl-create             // 名稱

### --- 建立rmq-cluster-StatefulSet

[root@k8s-master01 rabbit-cluster]# kubectl create -f rabbitmq-cluster-sts.yaml 
statefulset.apps/rmq-cluster created

十三、檢視建立的rmq-cluster資源

### --- 檢視建立的rmq-cluster

[root@k8s-master01 rabbit-cluster]# kubectl get po -n public-service -owide
NAME            READY   STATUS    RESTARTS   AGE    IP             NODE           NOMINATED NODE   READINESS GATES
rmq-cluster-0   1/1     Running   0          102s   172.25.92.70   k8s-master01   <none>           <none>
rmq-cluster-1   1/1     Running   0          71s    172.25.92.75   k8s-master02   <none>           <none>
rmq-cluster-2   0/1     Running   0          27s    172.25.92.74   k8s-master03   <none>           <none>

### --- 檢視rmq-cluster的日誌資訊

[root@k8s-master01 rabbit-cluster]# kubectl logs -f rmq-cluster-0 -n public-service
 * rabbitmq_management
 * rabbitmq_web_dispatch
 * rabbitmq_peer_discovery_k8s
 * rabbitmq_management_agent
 * rabbitmq_peer_discovery_common
 completed with 5 plugins.

### --- 檢視建立的容器，執行操作

[root@k8s-master01 rabbit-cluster]# kubectl exec -ti rmq-cluster-0 -n public-service -- bash
root@rmq-cluster-0:/# env | grep DEFAULT    // 檢視配置的變數
RABBITMQ_DEFAULT_PASS=RABBITMQ_PASS         // 密碼
RABBITMQ_DEFAULT_USER=RABBITMQ_USER         // 賬號

### --- 檢視它的service

[root@k8s-master01 rabbit-cluster]# kubectl get svc -n public-service
NAME                   TYPE        CLUSTER-IP      EXTERNAL-IP   PORT(S)                          AGE
rmq-cluster            ClusterIP   None            <none>        5672/TCP                         47h
rmq-cluster-balancer   NodePort    10.101.215.84   <none>        15672:31549/TCP,5672:31578/TCP   47h

### --- 檢視service對應的ep

[root@k8s-master01 rabbit-cluster]# kubectl get ep -n public-service
NAME                   ENDPOINTS                                                AGE
rmq-cluster            172.25.92.70:5672                                        2d1h
rmq-cluster-balancer   172.25.92.70:15672,172.25.92.75:15672172.25.92.70:5672   2d1h

===============================END===============================

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart ——W.S.Landor

來自為知筆記(Wiz)

|NO.Z.00265|——————————|^^ 部署 ^^|——|KuberNetes&中介軟體容器化及helm.V12|------------------------------------------|中介軟體.v01|RabbitMQ|部署|

相關推薦