Redis 4.0 叢集搭建完美方案及注意事項
阿新 • • 發佈：2018-12-25
一、部署Redis叢集環境準備
1.準備6臺redis伺服器（預設配置）
2.配置redis叢集
1)在每臺redis伺服器做叢集配置然後重啟服務IP 規劃：
redis 伺服器 ip 地址及埠規劃– redisA 192.168.4.51 6351 – redisB 192.168.4.52 6352
– redisC 192.168.4.53 6353 –redisD 192.168.4.54 6354
– redisE 192.168.4.55 6355 – redisF 192.168.4.56 6356
redis叢集伺服器配置步驟：
1.修改配置檔案
# vim /etc/redis/6379.conf
bind IP 地址 // 只寫物理介面 IP 地址
daemonize yes // 守護程序方式執行
port xxxx // 埠號不要使用預設的 6379
cluster-enabled yes // 開啟叢集
cluster-config-file no5x.conf // 叢集的配置檔案不要使用預設的名稱
cluster-node-timeout 5000 // 請求超時 5 秒2.重啟服務
由於已經把redis預設埠修了，登入服務時需要指定埠
[[email protected] opt]# redis-cli -h 192.168.4.51 -p 6351 shutdown //關閉服務
[[email protected] 3.檢查是否開啟叢集服務
> cluster nodes # 檢視本機資訊
> cluster info # 檢視叢集資訊
]# redis-cli -c -h 192.168.4.56 -p 6356
192.168.4.56:6356> cluster nodes
9d34277832cf73950c4b51c692065d4ba62b4ff3 :[email protected] myself,master - 0 0 0 connected]# cat /var/lib/redis/6379/nodes-6356.conf //redis開啟集群后預設回在資料庫目錄下生成配置檔案
9d34277832cf73950c4b51c692065d4ba62b4ff3 : 二、搭建Redis叢集管理服務
在這裡我們把192.168.4.51作為redis叢集的管理伺服器，以下包需要在redisA安裝
2.1.準備安裝包
redis-3.2.1.gem
ruby
rubuygems
ruby-devel-2.0
2.2 把源嗎包裡面src目錄下redis-trib.rb拷貝到 /usr/local/sbin/目錄下
[[email protected] redis-4.0.10]# cd src/
[[email protected] src]# cp redis-trib.rb /usr/local/bin/2.3安裝ruby指令碼執行環境包
# yum install -y ruby rubygems
# rpm -ivh --nodeps ruby-devel-2.00.648-30.el7.x86_64.rpm 忽略依賴關係安裝
# gem install redis-3.2.1.gem 2.4使用redis-trib.rb建立叢集
注意：建立叢集前需要保證所以Redis從庫記憶體資料和本地資料檔案為空，確保每臺伺服器卡開啟叢集功能。
命令格式：redis-trub.rb eare --replicas 1
--replicas 1 表示 自動為每一個 master 節點分配一個 slave 節點
# redis-trib.rb create --replicas 1 192.168.4.51:6351 192.168.4.52:6352 192.168.4.53:6353 192.168.4.54:6354 192.168.4.55:6355 192.168.4.56:6356
>>> Creating cluster
>>> Performing hash slots allocation on 6 nodes...
Using 3 masters:
192.168.4.51:6351
192.168.4.52:6352
192.168.4.53:6353
Adding replica 192.168.4.55:6355 to 192.168.4.51:6351
Adding replica 192.168.4.56:6356 to 192.168.4.52:6352
Adding replica 192.168.4.54:6354 to 192.168.4.53:6353
M: 8caf3ae34ed83ca83d27edadd11130677fca5e1c 192.168.4.51:6351
slots:0-5460 (5461 slots) master
M: 9264fabe9d3fe363d353481147f82f3b652b5ae4 192.168.4.52:6352
slots:5461-10922 (5462 slots) master
M: f04173772a74912dd220586d6c69b480fe62827e 192.168.4.53:6353
slots:10923-16383 (5461 slots) master
S: 7cc533d6b45fab75c5d4f99d222afc2683fd5a42 192.168.4.54:6354
replicates f04173772a74912dd220586d6c69b480fe62827e
S: 6638a3c63d672e2004459fac890e6c4aa42fb40e 192.168.4.55:6355
replicates 8caf3ae34ed83ca83d27edadd11130677fca5e1c
S: 9d34277832cf73950c4b51c692065d4ba62b4ff3 192.168.4.56:6356
replicates 9264fabe9d3fe363d353481147f82f3b652b5ae4
Can I set the above configuration? (type 'yes' to accept):yes
......
[OK] All 16384 slots covered. //叢集建立成功檢查叢集資訊
從以下資訊得出 192.168.4.51-53 為主庫 54-56為從庫，從庫綁定了對應主庫的ID值
# redis-trib.rb check 192.168.4.51:6351
>>> Performing Cluster Check (using node 192.168.4.51:6351)
M: 8caf3ae34ed83ca83d27edadd11130677fca5e1c 192.168.4.51:6351
slots:0-5460 (5461 slots) master
1 additional replica(s)
M: f04173772a74912dd220586d6c69b480fe62827e 192.168.4.53:6353
slots:10923-16383 (5461 slots) master
1 additional replica(s)
S: 9d34277832cf73950c4b51c692065d4ba62b4ff3 192.168.4.56:6356
slots: (0 slots) slave
replicates 9264fabe9d3fe363d353481147f82f3b652b5ae4
S: 7cc533d6b45fab75c5d4f99d222afc2683fd5a42 192.168.4.54:6354
slots: (0 slots) slave
replicates f04173772a74912dd220586d6c69b480fe62827e
S: 6638a3c63d672e2004459fac890e6c4aa42fb40e 192.168.4.55:6355
slots: (0 slots) slave
replicates 8caf3ae34ed83ca83d27edadd11130677fca5e1c
M: 9264fabe9d3fe363d353481147f82f3b652b5ae4 192.168.4.52:6352
slots:5461-10922 (5462 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.2.5 使用ruby指令碼檢查任意一臺叢集資訊
檢視機資訊
[[email protected] ~]# redis-cli -h 192.168.4.55 -p 6355
192.168.4.55:6355> cluster nodes
9d34277832cf73950c4b51c692065d4ba62b4ff3 192.168.4.56:[email protected] slave 9264fabe9d3fe363d353481147f82f3b652b5ae4 0 1530775096561 6 connected
7cc533d6b45fab75c5d4f99d222afc2683fd5a42 192.168.4.54:[email protected] slave f04173772a74912dd220586d6c69b480fe62827e 0 1530775096661 4 connected
f04173772a74912dd220586d6c69b480fe62827e 192.168.4.53:[email protected] master - 0 1530775096561 3 connected 10923-16383
8caf3ae34ed83ca83d27edadd11130677fca5e1c 192.168.4.51:[email protected] master - 0 1530775096000 1 connected 0-5460
6638a3c63d672e2004459fac890e6c4aa42fb40e 192.168.4.55:[email protected] myself,slave 8caf3ae34ed83ca83d27edadd11130677fca5e1c 0 1530775096000 5 connected
9264fabe9d3fe363d353481147f82f3b652b5ae4 192.168.4.52:[email protected] master - 0 1530775097663 2 connected 5461-10922檢查叢集狀態
192.168.4.55:6355> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:1
cluster_stats_messages_ping_sent:1947
cluster_stats_messages_pong_sent:1797
cluster_stats_messages_meet_sent:2
cluster_stats_messages_sent:3746
cluster_stats_messages_ping_received:1794
cluster_stats_messages_pong_received:1949
cluster_stats_messages_meet_received:3
cluster_stats_messages_received:3746
192.168.4.55:6355> 2.6同步測試
在客戶端訪問任意master角色的redis伺服器寫入資料
# redis-cli -c -h 192.168.4.52 -p 6352
192.168.4.52:6352> set name zx
OK
192.168.4.52:6352>在對應的從庫檢視
# redis-cli -c -h 192.168.4.52 -p 6352
192.168.4.56:6356> keys *
1) "name"
192.168.4.56:6356> get name
-> Redirected to slot [5798] located at 192.168.4.52:6352
"zx"Redis叢集補充：
1. redis-trib.rb 指令碼常用選項：
– add-node 新增新節點
– check 對節點主機做檢查
– reshard 對節點主機重新分片
– add-node --slave 新增從節點主機
– del-node 刪除節點主機
2. Redis 配置檔案常用配置選項：
– port 6379 // 埠
– bind 127.0.0.1 //IP 地址
– tcp-backlog 511 //tcp 連線總數
– timeout 0 // 連線超時時間
– tcp-keepalive 300 // 長連線時間
– daemonize yes // 守護程序方式執行
– databases 16 // 資料庫個數
– logfile /var/log/redis_6379.log //pid 檔案
– maxclients 10000 // 併發連線數量
– dir /var/lib/redis/6379 // 資料庫目錄