redis叢集之新增節點
阿新 • • 發佈:2018-12-25
操作環境
伺服器centos7.3, ip:47.52.41.245,所包含的叢集節點有7003,7004,7005
檢視所有節點資訊
- 沒有密碼情況下
redis-cli -c -p port cluster nodes
port:埠
- 有密碼情況下
redis-cli -c -p port -a password cluster nodes
password:密碼
port 是本伺服器叢集中任意節點的埠
[[email protected] /]# redis-cli -c -p 7003 cluster nodes
668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506343504317 2 connected 10923-16383
908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 15063435093
33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506343506319 1 connected 0-5460
cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5461-10922
3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506343507275
ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506343508277
新增節點
- 在先前已經搭建好叢集的伺服器47.52.41.245上面的/tmp/frank/redis/redis-3.2.1/redis_cluster下面新建一個資料夾7006,然後把7003下redis.config拷貝里面
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cd /tmp/frank/redis/redis-3.2.1/redis_cluster/
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# ls
7003 7004 7005
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# mkdir 7006
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cp /tmp/frank/redis/redis-3.2.1/redis_cluster/7003/redis.conf 7006
[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cd 7006
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# ls
redis.conf
- 修改redis.config,修改內容如下
port 7006 //埠
protected-mode no //關掉保護模式3.2之後 不然會報Sorry, can't connect to node
#bind 本機ip //預設ip為127.0.0.1,在3.2之後要註釋掉 daemonize yes //redis後臺執行
pidfile /var/run/redis_7006.pid//pidfile檔案對應7006
cluster-enabled yes //開啟叢集 把註釋#去掉
cluster-config-file nodes_7006.conf//叢集的配置 配置檔案首次啟動自動生成 7006
cluster-node-timeout 15000 //請求超時 預設15秒,可自行設定
appendonly yes //aof日誌開啟
- 開放伺服器和安全組的7006和17006(叢集對應的)埠,先啟動防火牆,然後開發對應埠,接著重慶防火牆,如果有安全組,安全組同樣要開啟
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# systemctl start firewalld.service
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --zone=public --add-port=7006/tcp --permanent
success
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --zone=public --add-port=17006/tcp --permanent
success
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --reload
success
4.啟動節點並檢視啟動狀態
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# redis-server redis.conf
[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# netstat -tnlp | grep redis
tcp 0 0 0.0.0.0:17003 0.0.0.0:* LISTEN 2228/redis-server *
tcp 0 0 0.0.0.0:17004 0.0.0.0:* LISTEN 2224/redis-server *
tcp 0 0 0.0.0.0:17005 0.0.0.0:* LISTEN 2232/redis-server *
tcp 0 0 0.0.0.0:17006 0.0.0.0:* LISTEN 3867/redis-server *
tcp 0 0 0.0.0.0:7003 0.0.0.0:* LISTEN 2228/redis-server *
tcp 0 0 0.0.0.0:7004 0.0.0.0:* LISTEN 2224/redis-server *
tcp 0 0 0.0.0.0:7005 0.0.0.0:* LISTEN 2232/redis-server *
tcp 0 0 0.0.0.0:7006 0.0.0.0:* LISTEN 3867/redis-server *
tcp6 0 0 :::17003 :::* LISTEN 2228/redis-server *
tcp6 0 0 :::17004 :::* LISTEN 2224/redis-server *
tcp6 0 0 :::17005 :::* LISTEN 2232/redis-server *
tcp6 0 0 :::17006 :::* LISTEN 3867/redis-server *
tcp6 0 0 :::7003 :::* LISTEN 2228/redis-server *
tcp6 0 0 :::7004 :::* LISTEN 2224/redis-server *
tcp6 0 0 :::7005 :::* LISTEN 2232/redis-server *
tcp6 0 0 :::7006 :::* LISTEN 3867/redis-server *
- 將新節點加入到叢集
執行 redis-trib.rb add-node host:port host1:port1
host:port:為新節點的主機和埠
host1:port1:為叢集裡面的某個節點主機和埠
[[email protected] 7006]# redis-trib.rb add-node 47.52.41.245:7006 47.52.41.245:7003
>>> Adding node 47.52.41.245:7006 to cluster 47.52.41.245:7003
>>> Performing Cluster Check (using node 47.52.41.245:7003)
M: cc86a24f3896ad7530e2687cf52582912f74b661 47.52.41.245:7003
slots:5461-10922 (5462 slots) master
1 additional replica(s)
M: 668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001
slots:10923-16383 (5461 slots) master
1 additional replica(s)
S: 908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002
slots: (0 slots) slave
replicates cc86a24f3896ad7530e2687cf52582912f74b661
M: 33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000
slots:0-5460 (5461 slots) master
1 additional replica(s)
S: 3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004
slots: (0 slots) slave
replicates 33d50636b5235de9970de2da75901b642d2b14d2
S: ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005
slots: (0 slots) slave
replicates 668397aba571ece85532b1eb1fccb42e4e33b1f2
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
[WARNING] Node 116.196.65.198:7001 has slots in importing state (5598,8235).
[WARNING] Node 116.196.65.198:7000 has slots in importing state (5598,8235).
[WARNING] The following slots are open: 5598,8235
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 47.52.41.245:7006 to make it join the cluster.
[OK] New node added correctly.
- 檢視新增節點
[[email protected] 7006]# redis-cli -c -p 7003 cluster nodes
668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506345812199 2 connected 10923-16383
908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 1506345808190 4 connected
33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506345811199 1 connected 0-5460
cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5461-10922
f38c5163523a5040372f58b95cd184c601fd9388 47.52.41.245:7006 master - 0 1506345807145 0 connected
3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506345809150 5 connected
ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506345809651 6 connected
- 增加了新的節點之後,這個新的節點可以成為主節點或者是從節點
把這個節點變成主節點,使用redis-trib程式,將叢集中的某些雜湊槽移動到新節點裡面, 這個新節點就成為真正的主節點了。
執行下面的命令對叢集中的雜湊槽進行移動
cd /usr/local/redis3.0/src
./redis-trib.rb reshard 47.52.41.245:7003
執行過程中系統會提示我們要移動多少雜湊槽,這裡移動1000個,然後我們就輸入1000.接著會問你需要指定把這些雜湊槽轉移到哪個節點上,然後輸入我們新增的節點id f38c5163523a5040372f58b95cd184c601fd9388,緊接著會問需要從哪幾個節點轉移,輸入all就行了,由redis叢集自己分配,然後再輸入yes就OK了。然後檢視一下節點狀態
[[email protected] 7006]# redis-cli -c -p 7003 cluster nodes
668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506349557418 2 connected 10923-16383
908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 1506349558418 4 connected
33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506349555415 1 connected 0-5460
cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5598-10922 [5598->-f38c5163523a5040372f58b95cd184c601fd9388]
f38c5163523a5040372f58b95cd184c601fd9388 47.52.41.245:7006 master - 0 1506349556372 7 connected 5461-5597
3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506349553367 5 connected
ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506349558876 6 connected
已經有了插槽
- 如果想要把新節點變成某個節點的從節點執行如下命令,前提新節點還沒有分配雜湊槽
redis-cli -c -p 7006 cluster replicate 33d50636b5235de9970de2da75901b642d2b14d2
33d50636b5235de9970de2da75901b642d2b14d2
為某個主節點的id。
通過如下命令檢視是否成功
redis-cli -p 7000 cluster nodes | grep slave | grep 33d50636b5235de9970de2da75901b642d2b14d2
7000為主節點的埠,33d50636b5235de9970de2da75901b642d2b14d2為主節點的id
- 可能出現問題
ERR] Nodes don't agree about configuration!
>>> Check for open slots...
[WARNING] Node 116.196.65.198:7000 has slots in importing state (5608).
[WARNING] The following slots are open: 5608
可以通過如下命令解決
#先連線叢集
redis-cli -h 116.196.65.198 -c -p 7000
#然後輸入
cluster setslot 5608 stable
#或者通過
redis-trib.rb fix 116.196.65.198:7000