簡介

本節主要說明如何安裝，配置及執行harbor私有庫。

獲取Harbor 1.6源

git clone -b release-1.6.0 https://github.com/goharbor/harbor.git

修改harbor.cfg

# cd harbor/make
# vim harbor.cfg
# 主要修改以下幾項:
hostname = hub.example.com  # 按實際情況修改
ui_url_protocol = https     # http -> https
ssl_cert = /etc/k8s/ssl/ssl.crt       # 改成ssl檔案的實際目錄路徑
 

ssl_cert_key = /etc/k8s/ssl/ssl.key
secretkey_path = /opt
harbor_admin_password = xxxxx

給K8s新增gluster的endpoint和service

#cd make/kubernetes
#mkdir glusterfs
# 新建glusterfs/harbor-gluster.yaml, 填入如下內容：
apiVersion: v1
kind: Endpoints
metadata:
  name: ep-glusterfs-harbor-r2
subsets:
- addresses:
  - ip: 192.168.1.xx  # 這裡修改為實際的gluster-manager-ip
 

  ports:
  - port: 49152
    protocol: TCP

---
apiVersion: v1
kind: Service
metadata:
  name: ep-glusterfs-harbor-r2
spec:
  ports:
  - port: 49152
    protocol: TCP
    targetPort: 49152
  sessionAffinity: None
  type: ClusterIP

修改pv/registy.pv.yaml,pv/storage.pv.yaml配置

#cd make/kubernetes/pv
#vim registy.pv.yaml, 修改儲存為glusterfs：
 

apiVersion: v1
kind: PersistentVolume
metadata:
  name: registry-pv
  labels:
    type: registry
spec:
  capacity:
    storage: 100Gi
  accessModes:
    - ReadWriteMany
  persistentVolumeReclaimPolicy: Retain
  glusterfs:
    endpoints: "ep-glusterfs-harbor-r2"
    path: "harbordata"
    readOnly: false

#vim storage.pv.yaml, 修改儲存為glusterfs：
apiVersion: v1
kind: PersistentVolume
metadata:
  name: storage-pv
  labels:
    type: storage
spec:
  capacity:
    storage: 20Gi
  accessModes:
    - ReadWriteMany
  persistentVolumeReclaimPolicy: Retain
  glusterfs:
    endpoints: "ep-glusterfs-harbor-r2"
    path: "harbordata"
    readOnly: false

修改mysql的儲存源

#cd make/kubernetes/mysql
#vim mysql.deploy.yaml, 使用共享儲存storage-pvc
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: mysql
  labels:
    name: mysql
spec:
  replicas: 1
  template:
    metadata:
      labels:
        name: mysql-apps
    spec:
      containers:
      - name: mysql-app
        image: vmware/harbor-db:v1.2.0
        imagePullPolicy: IfNotPresent
        ports:
        - containerPort: 3306
        env:
          - name: MYSQL_ROOT_PASSWORD
            valueFrom: 
              configMapKeyRef: 
               name: harbor-mysql-config
               key: MYSQL_ROOT_PASSWORD
        volumeMounts:
        - name: mysql-storage
          mountPath: /var/lib/mysql
          subPath: "storage"
      volumes:
      - name: mysql-storage
        persistentVolumeClaim:
          claimName: storage-pvc 

修改registry的儲存源

#cd make/kubernetes/registry/
#vim registry.deploy.yaml, 使用共享儲存registry-pvc
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  name: registry
  labels:
    name: registry
spec:
  replicas: 1
  template:
    metadata:
      labels:
        name: registry-apps
    spec:
      initContainers:
      - name: init-registry-app
        image: vmware/registry:2.6.2-photon
        command: ['sh', '-c', "cp -f /etc/registry/tmpconfig/* /tmp/"]
        volumeMounts:
        - name: workdir
          mountPath: /tmp
        - name: config
          mountPath: /etc/registry/tmpconfig
      containers:
      - name: registry-app
        image: vmware/registry:2.6.2-photon
        imagePullPolicy: IfNotPresent
        ports:
        - containerPort: 5000
        - containerPort: 5001
        volumeMounts:
        - name: workdir
          mountPath: /etc/registry
        - name: storage
          mountPath: /storage
          subPath: "registry"
      volumes:
      - name: config
        configMap:
          name: harbor-registry-config
          items:
          - key: config
            path: config.yml
          - key: cert
            path: root.crt
      - name: workdir
        emptyDir: {}
      - name: storage
        persistentVolumeClaim:
          claimName: registry-pvc

注意這裡的configMap的掛載由於readonly的原因，採取了emptyDir曲線救國的方式

生成configmap檔案

python make/kubernetes/k8s-prepare

修改預設的ingress.yaml

# 修改後內容如下：
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: harbor
  annotations:
    nginx.ingress.kubernetes.io/proxy-body-size: 2048m
    nginx.ingress.kubernetes.io/upstream-hash-by: "$remote_addr"
    ingress.kubernetes.io/ssl-redirect: "false"
spec:
  rules:
  - host: hub.xxx.com
    http:
      paths:
      - path: /
        backend:
          serviceName: ui
          servicePort: 80
      - path: /v2
        backend:
          serviceName: registry
          servicePort: repo
      - path: /service
        backend:
          serviceName: ui
          servicePort: 80

根據官方文件按順序啟動服務

# create pv & pvc
kubectl apply -f make/kubernetes/glusterfs/harbor-gluster.yaml
kubectl apply -f make/kubernetes/pv/log.pv.yaml
kubectl apply -f make/kubernetes/pv/registry.pv.yaml
kubectl apply -f make/kubernetes/pv/storage.pv.yaml
kubectl apply -f make/kubernetes/pv/log.pvc.yaml
kubectl apply -f make/kubernetes/pv/registry.pvc.yaml
kubectl apply -f make/kubernetes/pv/storage.pvc.yaml

> # create config map
kubectl apply -f make/kubernetes/jobservice/jobservice.cm.yaml
kubectl apply -f make/kubernetes/mysql/mysql.cm.yaml
kubectl apply -f make/kubernetes/registry/registry.cm.yaml
kubectl apply -f make/kubernetes/ui/ui.cm.yaml
kubectl apply -f make/kubernetes/adminserver/adminserver.cm.yaml

# create service
kubectl apply -f make/kubernetes/jobservice/jobservice.svc.yaml
kubectl apply -f make/kubernetes/mysql/mysql.svc.yaml
kubectl apply -f make/kubernetes/registry/registry.svc.yaml
kubectl apply -f make/kubernetes/ui/ui.svc.yaml
kubectl apply -f make/kubernetes/adminserver/adminserver.svc.yaml

# create k8s deployment
kubectl apply -f make/kubernetes/registry/registry.deploy.yaml
kubectl apply -f make/kubernetes/mysql/mysql.deploy.yaml
kubectl apply -f make/kubernetes/jobservice/jobservice.deploy.yaml
kubectl apply -f make/kubernetes/ui/ui.deploy.yaml
kubectl apply -f make/kubernetes/adminserver/adminserver.deploy.yaml

# create k8s ingress
kubectl apply -f make/kubernetes/ingress.yaml

traefik ui 檢視效果

ui登入harbor

另外，也可以用命令docker login hub.xxx.com,docker push xxx等方法來驗證是否安裝成功。