1. 程式人生 > >redis叢集之新增節點

redis叢集之新增節點

操作環境

伺服器centos7.3, ip:47.52.41.245,所包含的叢集節點有7003,7004,7005

檢視所有節點資訊

  1. 沒有密碼情況下
redis-cli -c -p port cluster nodes

port:埠

  1. 有密碼情況下
redis-cli -c -p port -a password cluster nodes

password:密碼

port 是本伺服器叢集中任意節點的埠

[[email protected] /]# redis-cli -c -p 7003 cluster nodes
668397aba571ece85532b1eb1fccb42e4e33b1f2
116.196.65.198:7001 master - 0 1506343504317 2 connected 10923-16383 908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 15063435093 33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506343506319 1 connected 0-5460 cc86a24f3896ad7530e2687cf52582912f74b661
172.31.195.1:7003 myself,master - 0 0 4 connected 5461-10922 3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506343507275 ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506343508277

新增節點

  1. 在先前已經搭建好叢集的伺服器47.52.41.245上面的/tmp/frank/redis/redis-3.2.1/redis_cluster下面新建一個資料夾7006,然後把7003下redis.config拷貝里面
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cd /tmp/frank/redis/redis-3.2.1/redis_cluster/
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# ls
7003  7004  7005
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# mkdir 7006
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cp /tmp/frank/redis/redis-3.2.1/redis_cluster/7003/redis.conf 7006
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cd 7006
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# ls
redis.conf
  1. 修改redis.config,修改內容如下
port  7006                      //埠    
protected-mode no   //關掉保護模式3.2之後 不然會報Sorry, can't connect to node
#bind 本機ip //預設ip為127.0.0.1,在3.2之後要註釋掉 daemonize    yes //redis後臺執行
pidfile  /var/run/redis_7006.pid//pidfile檔案對應7006
cluster-enabled  yes            //開啟叢集  把註釋#去掉
cluster-config-file  nodes_7006.conf//叢集的配置  配置檔案首次啟動自動生成 7006
cluster-node-timeout  15000     //請求超時  預設15秒,可自行設定
appendonly  yes             //aof日誌開啟 
  1. 開放伺服器和安全組的7006和17006(叢集對應的)埠,先啟動防火牆,然後開發對應埠,接著重慶防火牆,如果有安全組,安全組同樣要開啟
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# systemctl start firewalld.service
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --zone=public --add-port=7006/tcp --permanent
success
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --zone=public --add-port=17006/tcp --permanent
success
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --reload
success

4.啟動節點並檢視啟動狀態

[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# redis-server redis.conf 
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# netstat -tnlp | grep redis
tcp        0      0 0.0.0.0:17003           0.0.0.0:*               LISTEN      2228/redis-server * 
tcp        0      0 0.0.0.0:17004           0.0.0.0:*               LISTEN      2224/redis-server * 
tcp        0      0 0.0.0.0:17005           0.0.0.0:*               LISTEN      2232/redis-server * 
tcp        0      0 0.0.0.0:17006           0.0.0.0:*               LISTEN      3867/redis-server * 
tcp        0      0 0.0.0.0:7003            0.0.0.0:*               LISTEN      2228/redis-server * 
tcp        0      0 0.0.0.0:7004            0.0.0.0:*               LISTEN      2224/redis-server * 
tcp        0      0 0.0.0.0:7005            0.0.0.0:*               LISTEN      2232/redis-server * 
tcp        0      0 0.0.0.0:7006            0.0.0.0:*               LISTEN      3867/redis-server * 
tcp6       0      0 :::17003                :::*                    LISTEN      2228/redis-server * 
tcp6       0      0 :::17004                :::*                    LISTEN      2224/redis-server * 
tcp6       0      0 :::17005                :::*                    LISTEN      2232/redis-server * 
tcp6       0      0 :::17006                :::*                    LISTEN      3867/redis-server * 
tcp6       0      0 :::7003                 :::*                    LISTEN      2228/redis-server * 
tcp6       0      0 :::7004                 :::*                    LISTEN      2224/redis-server * 
tcp6       0      0 :::7005                 :::*                    LISTEN      2232/redis-server * 
tcp6       0      0 :::7006                 :::*                    LISTEN      3867/redis-server * 
  1. 將新節點加入到叢集

執行 redis-trib.rb add-node host:port host1:port1

host:port:為新節點的主機和埠

host1:port1:為叢集裡面的某個節點主機和埠

[[email protected] 7006]# redis-trib.rb add-node 47.52.41.245:7006 47.52.41.245:7003
>>> Adding node 47.52.41.245:7006 to cluster 47.52.41.245:7003
>>> Performing Cluster Check (using node 47.52.41.245:7003)
M: cc86a24f3896ad7530e2687cf52582912f74b661 47.52.41.245:7003
   slots:5461-10922 (5462 slots) master
   1 additional replica(s)
M: 668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001
   slots:10923-16383 (5461 slots) master
   1 additional replica(s)
S: 908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002
   slots: (0 slots) slave
   replicates cc86a24f3896ad7530e2687cf52582912f74b661
M: 33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000
   slots:0-5460 (5461 slots) master
   1 additional replica(s)
S: 3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004
   slots: (0 slots) slave
   replicates 33d50636b5235de9970de2da75901b642d2b14d2
S: ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005
   slots: (0 slots) slave
   replicates 668397aba571ece85532b1eb1fccb42e4e33b1f2
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
[WARNING] Node 116.196.65.198:7001 has slots in importing state (5598,8235).
[WARNING] Node 116.196.65.198:7000 has slots in importing state (5598,8235).
[WARNING] The following slots are open: 5598,8235
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 47.52.41.245:7006 to make it join the cluster.
[OK] New node added correctly.
  1. 檢視新增節點
[[email protected] 7006]# redis-cli -c -p 7003 cluster nodes
668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506345812199 2 connected 10923-16383
908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 1506345808190 4 connected
33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506345811199 1 connected 0-5460
cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5461-10922
f38c5163523a5040372f58b95cd184c601fd9388 47.52.41.245:7006 master - 0 1506345807145 0 connected
3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506345809150 5 connected
ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506345809651 6 connected
  1. 增加了新的節點之後,這個新的節點可以成為主節點或者是從節點

把這個節點變成主節點,使用redis-trib程式,將叢集中的某些雜湊槽移動到新節點裡面, 這個新節點就成為真正的主節點了。
執行下面的命令對叢集中的雜湊槽進行移動

cd /usr/local/redis3.0/src
./redis-trib.rb reshard 47.52.41.245:7003

執行過程中系統會提示我們要移動多少雜湊槽,這裡移動1000個,然後我們就輸入1000.接著會問你需要指定把這些雜湊槽轉移到哪個節點上,然後輸入我們新增的節點id f38c5163523a5040372f58b95cd184c601fd9388,緊接著會問需要從哪幾個節點轉移,輸入all就行了,由redis叢集自己分配,然後再輸入yes就OK了。然後檢視一下節點狀態

[[email protected] 7006]# redis-cli -c -p 7003 cluster nodes
668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506349557418 2 connected 10923-16383
908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 1506349558418 4 connected
33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506349555415 1 connected 0-5460
cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5598-10922 [5598->-f38c5163523a5040372f58b95cd184c601fd9388]
f38c5163523a5040372f58b95cd184c601fd9388 47.52.41.245:7006 master - 0 1506349556372 7 connected 5461-5597
3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506349553367 5 connected
ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506349558876 6 connected

已經有了插槽

  1. 如果想要把新節點變成某個節點的從節點執行如下命令,前提新節點還沒有分配雜湊槽
redis-cli -c -p 7006 cluster replicate 33d50636b5235de9970de2da75901b642d2b14d2 

33d50636b5235de9970de2da75901b642d2b14d2
為某個主節點的id。

通過如下命令檢視是否成功

redis-cli -p 7000 cluster nodes | grep slave | grep 33d50636b5235de9970de2da75901b642d2b14d2

7000為主節點的埠,33d50636b5235de9970de2da75901b642d2b14d2為主節點的id

  1. 可能出現問題
ERR] Nodes don't agree about configuration!
>>> Check for open slots...
[WARNING] Node 116.196.65.198:7000 has slots in importing state (5608).
[WARNING] The following slots are open: 5608

可以通過如下命令解決

#先連線叢集
redis-cli -h 116.196.65.198 -c -p 7000
#然後輸入
cluster setslot 5608 stable

#或者通過
redis-trib.rb fix 116.196.65.198:7000