環境：OEL 5.7 + Oracle 10.2.0.5 RAC
需求：更換存儲，OCR、Voting disk同時需要更換到新存儲。

• 1.替換OCR
• 2.替換voting disk

1.替換OCR

替換OCR（Oracle Cluster Registry）首先需要關閉RAC所有節點的crs，然後導出當前的ocr配置文件，手工修改ocr.loc文件後，導入ocr配置文件，可選擇性創建ocrmirror。
本次實驗演示就是將原來的/dev/raw/raw1替換為/dev/raw/raw14，並創建ocrmirror為/dev/raw/raw15.

--replace ocr
--兩個節點關閉crs
/s01/oracle/product/10.2.0/crs_1/bin/crsctl stop crs
--ocrcheck
/s01/oracle/product/10.2.0/crs_1/bin/ocrcheck 
--導出ocr的配置
/s01/oracle/product/10.2.0/crs_1/bin/ocrconfig -export /tmp/ocrfile.dmp 
--查看文件大小
ls -lrt /tmp/ocrfile.dmp 
--兩個節點修改ocr為新的/dev/raw/raw14
cat /etc/oracle/ocr.loc 
--導入ocr配置文件
/s01/oracle/product/10.2.0/crs_1/bin/ocrconfig -import /tmp/ocrfile.dmp 
/s01/oracle/product/10.2.0/crs_1/bin/ocrcheck 
--增加ocrmirror
/s01/oracle/product/10.2.0/crs_1/bin/ocrconfig -replace ocrmirror /dev/raw/raw15
/s01/oracle/product/10.2.0/crs_1/bin/ocrcheck
--最後查看ocr.loc文件
cat /etc/oracle/ocr.loc 
 

實際測試替換OCR的關鍵操作：

[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl stop crs
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/ocrconfig -export /tmp/ocrfile.dmp 
[root@rac1-server rules.d]# vi /etc/oracle/ocr.loc 
ocrconfig_loc=/dev/raw/raw14
local_only=FALSE
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/ocrconfig -replace ocrmirror /dev/raw/raw15
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          2
         Total space (kbytes)     :      96144
         Used space (kbytes)      :       4652
         Available space (kbytes) :      91492
         ID                       : 1953645605
         Device/File Name         : /dev/raw/raw14
                                    Device/File integrity check succeeded
         Device/File Name         : /dev/raw/raw15
                                    Device/File integrity check succeeded

         Cluster registry integrity check succeeded

[root@rac1-server ~]#  cat /etc/oracle/ocr.loc 
#Device/file  getting replaced by device /dev/raw/raw15 
ocrconfig_loc=/dev/raw/raw14
ocrmirrorconfig_loc=/dev/raw/raw15
local_only=false
[root@rac1-server ~]# 
 

2.替換voting disk

替換voting disk比較簡單，只需要把新的voting disk加進來，然後把舊的刪除即可。
本次實驗演示就是新加/dev/raw/raw11,/dev/raw/raw12,/dev/raw/raw13,然後將原來的/dev/raw/raw2刪除。

--replace voting disk
--which crsctl確認crsctl的全路徑
/s01/oracle/product/10.2.0/crs_1/bin/crsctl
--查詢當前的votedisk
crsctl query css votedisk
--添加新的votedisk
crsctl add css votedisk /dev/raw/raw11 -force
crsctl add css votedisk /dev/raw/raw12 -force
crsctl add css votedisk /dev/raw/raw13 -force
--刪除舊的votedisk
crsctl delete css votedisk /dev/raw/raw2 -force
 

實際替換voting disk的關鍵操作：

[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl add css votedisk /dev/raw/raw11 
Cluster is not in a ready state for online disk addition
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl add css votedisk /dev/raw/raw11 -force
Now formatting voting disk: /dev/raw/raw11
successful addition of votedisk /dev/raw/raw11.
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl query css votedisk
 0.     0    /dev/raw/raw2
 1.     0    /dev/raw/raw11

located 2 votedisk(s).
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl add css votedisk /dev/raw/raw12 -force
Now formatting voting disk: /dev/raw/raw12
successful addition of votedisk /dev/raw/raw12.
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl add css votedisk /dev/raw/raw13 -force
Now formatting voting disk: /dev/raw/raw13
successful addition of votedisk /dev/raw/raw13.
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl query css votedisk
 0.     0    /dev/raw/raw2
 1.     0    /dev/raw/raw11
 2.     0    /dev/raw/raw12
 3.     0    /dev/raw/raw13

located 4 votedisk(s).
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl delete css votedisk /dev/raw/raw2
Cluster is not in a ready state for online disk removal
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl delete css votedisk /dev/raw/raw2 -force
successful deletion of votedisk /dev/raw/raw2.
[root@rac1-server rules.d]# /s01/oracle/product/10.2.0/crs_1/bin/crsctl query css votedisk
 0.     0    /dev/raw/raw11
 1.     0    /dev/raw/raw12
 2.     0    /dev/raw/raw13

located 3 votedisk(s).
[root@rac1-server rules.d]# 

附錄：本次實驗環境：
1.舊存儲模擬：4塊盤：其中第1塊盤分成了2個區，綁定為raw設備raw1和raw2，分別給ocr和voting disk使用，剩余3塊是給ASM使用的：

2.新存儲模擬：10塊盤：其中前三塊（raw11，raw12，raw13）給voting disk使用，第4塊和第5塊（raw14和raw15）給ocr使用：

3.使用新存儲3塊10G的盤和2塊5G的盤分別新增DATADG和FRA2個ASM磁盤組，其中DATADG是Normal冗余，FRA是External冗余：

Oracle 10g RAC OCR、Voting disk更換