遷移OCR、表決磁碟和asm spfile到其他磁碟組中
阿新 • • 發佈：2019-02-16
本文參考：https://levipereira.wordpress.com/2012/01/11/explaining-how-to-store-ocr-voting-disks-and-asm-spfile-on-asm-diskgroup-rac-or-rac-extended/
最初磁碟組+CRSTMP 裡有一個voting 檔案, ocr 和 asm spfile.
遷移後磁碟組CRS儲存OCR檔案和asm spfile，磁碟組VOTE儲存表決磁碟和OCR MIRROR
檢查節點是否為Actives:
$ olsnodes -s lnxora01 Active lnxora02 Active lnxora03 Active
使用OCRCHECK檢視OCR檔案的儲存位置：
使用CRSCTL查看錶決檔案的儲存位置：$ ocrcheck Status of Oracle Cluster Registry is as follows : Version : 3 Total space (kbytes) : 262120 Used space (kbytes) : 3848 Available space (kbytes) : 258272 ID : 1997055112 Device/File Name : +CRSTMP Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user
$ crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE a0d6ea8dfb944fe7bfb799a451195a18 (ORCL:CRSTMP01) [CRSTMP]
Located 1 voting disk(s).獲取ASM上關於表決磁碟的資訊。我們在ASM上不能看到表決磁碟的檔案，我們只知道表決磁碟儲存在asmdisk上。$ asmcmd spget +CRSTMP/testcluster/ASMPARAMETERFILE/REGISTRY.253.772133609
SET LINESIZE 150
COL PATH FOR A30
COL NAME FOR A10
COL HEADER_STATUS FOR A20
COL FAILGROUP FOR A20
COL FAILGROUP_TYPE FOR A20
COL VOTING_FILE FOR A20
SELECT NAME,PATH,HEADER_STATUS,FAILGROUP, FAILGROUP_TYPE, VOTING_FILE
FROM V$ASM_DISK
WHERE GROUP_NUMBER = ( SELECT GROUP_NUMBER
FROM V$ASM_DISKGROUP
WHERE NAME='CRSTMP');
NAME PATH HEADER_STATUS FAILGROUP FAILGROUP_TYPE VOTING_FILE
---------- ------------------------------ -------------------- -------------------- -------------------- --------------------
CRSTMP01 ORCL:CRSTMP01 MEMBER CRSTMP01 REGULAR Y
olsnodes -c : 顯示叢集的名稱
$ olsnodes -c
tstcluster
set linesize 100
col FILES_OF_CLUSTER for a60
select concat('+'||gname, sys_connect_by_path(aname, '/')) FILES_OF_CLUSTER
from ( select b.name gname, a.parent_index pindex, a.name aname,
a.reference_index rindex , a.system_created, a.alias_directory,
c.type file_type
from v$asm_alias a, v$asm_diskgroup b, v$asm_file c
where a.group_number = b.group_number
and a.group_number = c.group_number(+)
and a.file_number = c.file_number(+)
and a.file_incarnation = c.incarnation(+)
) WHERE file_type in ( 'ASMPARAMETERFILE','OCRFILE')
start with (mod(pindex, power(2, 24))) = 0
and rindex in
( select a.reference_index
from v$asm_alias a, v$asm_diskgroup b
where a.group_number = b.group_number
and (mod(a.parent_index, power(2, 24))) = 0
and a.name = LOWER('&CLUSTERNAME')
)
connect by prior rindex = pindex;
Enter value for clustername: tstcluster
old 17: and a.name = LOWER('&CLUSTERNAME')
new 17: and a.name = LOWER('tstcluster')
FILES_OF_CLUSTER
---------------------------------------------------------
+CRSTMP/tstcluster/OCRFILE/REGISTRY.255.772133361
+CRSTMP/tstclsuter/ASMPARAMETERFILE/REGISTRY.253.772133609 col path for a30
col name for a20
col header_status for a20
select path,name,header_status from v$asm_disk
where path like '%CRS%' or path like '%VOTE%';
PATH NAME HEADER_STATUS
------------------------------ -------------------- --------------------
ORCL:CRS01 PROVISIONED
ORCL:CRS02 PROVISIONED
ORCL:VOTE01 PROVISIONED
ORCL:VOTE02 PROVISIONED
ORCL:VOTE03 PROVISIONED
ORCL:CRSTMP01 CRSTMP01 MEMBERCREATE DISKGROUP VOTE NORMAL REDUNDANCY
FAILGROUP STG1_C1 DISK 'ORCL:VOTE01'
FAILGROUP STG1_C2 DISK 'ORCL:VOTE02'
FAILGROUP STG1_C1_1 DISK 'ORCL:VOTE03'
ATTRIBUTE 'compatible.asm' = '11.2.0.0.0';
Diskgroup created.
# 在其他節點上啟動磁碟組
SQL> ! srvctl start diskgroup -g vote -n lnxora02,lnxora03
# 檢查磁碟組是否活動在所有節點上
SQL> ! srvctl status diskgroup -g vote
Disk Group vote is running on lnxora01,lnxora02,lnxora03SQL>
CREATE DISKGROUP CRS NORMAL REDUNDANCY
FAILGROUP STG1_C1 DISK 'ORCL:CRS01'
FAILGROUP STG1_C2 DISK 'ORCL:CRS02'
ATTRIBUTE 'compatible.asm' = '11.2.0.0.0';
Diskgroup created.
# 在其他節點上啟動磁碟組
SQL> ! srvctl start diskgroup -g crs -n lnxora02,lnxora03
# 檢查磁碟組是否活動在所有節點上
SQL> ! srvctl status diskgroup -g crs
Disk Group crs is running on lnxora01,lnxora02,lnxora03
SQL>
SET LINESIZE 150
COL PATH FOR A30
COL NAME FOR A10
COL HEADER_STATUS FOR A20
COL FAILGROUP FOR A20
COL FAILGROUP_TYPE FOR A20
COL VOTING_FILE FOR A20
SELECT NAME,PATH,HEADER_STATUS,FAILGROUP, FAILGROUP_TYPE, VOTING_FILE
FROM V$ASM_DISK
WHERE GROUP_NUMBER IN ( SELECT GROUP_NUMBER
FROM V$ASM_DISKGROUP
WHERE NAME IN ('CRS','VOTE'));
NAME PATH HEADER_STATUS FAILGROUP FAILGROUP_TYPE VOTING_FILE
---------- ------------------------------ -------------------- -------------------- -------------------- --------------------
VOTE03 ORCL:VOTE03 MEMBER STG1_C1_1 REGULAR N
VOTE02 ORCL:VOTE02 MEMBER STG1_C2 REGULAR N
VOTE01 ORCL:VOTE01 MEMBER STG1_C1 REGULAR N
CRS01 ORCL:CRS01 MEMBER STG1_C1 REGULAR N
CRS02 ORCL:CRS02 MEMBER STG1_C2 REGULAR N$ crsctl replace votedisk +VOTE
Successful addition of voting disk aaa75b9e7ce24f39bfd9eecb3e3c0e38.
Successful addition of voting disk 873d51346cd34fc2bf9caa94999c4cd8.
Successful addition of voting disk acda8619b74c4fe8bf886ee6c9fe8d1a.
Successful deletion of voting disk a0d6ea8dfb944fe7bfb799a451195a18.
Successfully replaced voting disk group with +VOTE.
CRS-4266: Voting file(s) successfully replaced
$ crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE aaa75b9e7ce24f39bfd9eecb3e3c0e38 (ORCL:VOTE01) [VOTE]
2. ONLINE 873d51346cd34fc2bf9caa94999c4cd8 (ORCL:VOTE02) [VOTE]
3. ONLINE acda8619b74c4fe8bf886ee6c9fe8d1a (ORCL:VOTE03) [VOTE]
Located 3 voting disk(s).
SET LINESIZE 150
COL PATH FOR A30
COL NAME FOR A10
COL HEADER_STATUS FOR A20
COL FAILGROUP FOR A20
COL FAILGROUP_TYPE FOR A20
COL VOTING_FILE FOR A20
SELECT NAME,PATH,HEADER_STATUS,FAILGROUP, FAILGROUP_TYPE, VOTING_FILE
FROM V$ASM_DISK
WHERE GROUP_NUMBER = ( SELECT GROUP_NUMBER
FROM V$ASM_DISKGROUP
WHERE NAME='VOTE');
NAME PATH HEADER_STATUS FAILGROUP FAILGROUP_TYPE VOTING_FILE
---------- ------------------------------ -------------------- -------------------- -------------------- --------------------
VOTE03 ORCL:VOTE03 MEMBER STG1_C1_1 REGULAR Y
VOTE02 ORCL:VOTE02 MEMBER STG1_C2 REGULAR Y
VOTE01 ORCL:VOTE01 MEMBER STG1_C1 REGULAR Y
# /u01/app/11.2.0/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3868
Available space (kbytes) : 258252
ID : 1997055112
Device/File Name : +CRSTMP
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
# /u01/app/11.2.0/grid/bin/ocrconfig -add +CRS
# /u01/app/11.2.0/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3836
Available space (kbytes) : 258284
ID : 1997055112
Device/File Name : +CRSTMP
Device/File integrity check succeeded
Device/File Name : +CRS
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
# /u01/app/11.2.0/grid/bin/ocrconfig -add +VOTE
/u01/app/11.2.0/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3836
Available space (kbytes) : 258284
ID : 1997055112
Device/File Name : +CRSTMP
Device/File integrity check succeeded
Device/File Name : +CRS
Device/File integrity check succeeded
Device/File Name : +VOTE
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
# /u01/app/11.2.0/grid/bin/ocrconfig -delete +CRSTMP
/u01/app/11.2.0/grid/bin/ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3836
Available space (kbytes) : 258284
ID : 1997055112
Device/File Name : +CRS
Device/File integrity check succeeded
Device/File Name : +VOTE
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded你會得到一個檔案正在使用中的錯誤，但實際上已經將檔案複製到檔案系統和配置檔案中。
$ asmcmd spget
+CRSTMP/tstcluster/ASMPARAMETERFILE/REGISTRY.253.772133609
$ asmcmd spmove '+CRSTMP/tstcluster/ASMPARAMETERFILE/REGISTRY.253.772133609' '+CRS/tstcluster/spfileASM.ora'
ORA-15032: not all alterations performed
ORA-15028: ASM file '+CRSTMP/tstcluster/ASMPARAMETERFILE/REGISTRY.253.772133609' not dropped; currently being accessed (DBD ERROR: OCIStmtExecute)
# 檢查是否已經更新
$ asmcmd spget
+CRS/tstcluster/spfileASM.oraset linesize 100
col FILES_OF_CLUSTER for a60
select concat('+'||gname, sys_connect_by_path(aname, '/')) FILES_OF_CLUSTER
from ( select b.name gname, a.parent_index pindex, a.name aname,
a.reference_index rindex , a.system_created, a.alias_directory,
c.type file_type
from v$asm_alias a, v$asm_diskgroup b, v$asm_file c
where a.group_number = b.group_number
and a.group_number = c.group_number(+)
and a.file_number = c.file_number(+)
and a.file_incarnation = c.incarnation(+)
) WHERE file_type in ( 'ASMPARAMETERFILE','OCRFILE')
start with (mod(pindex, power(2, 24))) = 0
and rindex in
( select a.reference_index
from v$asm_alias a, v$asm_diskgroup b
where a.group_number = b.group_number
and (mod(a.parent_index, power(2, 24))) = 0
and a.name = LOWER('&CLUSTERNAME')
)
connect by prior rindex = pindex;
Enter value for clustername: tstcluster
old 17: and a.name = LOWER('&CLUSTERNAME')
new 17: and a.name = LOWER('tstcluster')
FILES_OF_CLUSTER
------------------------------------------------------------
+CRSTMP/tstcluster/OCRFILE/REGISTRY.255.772133361
+CRSTMP/tstcluster/ASMPARAMETERFILE/REGISTRY.253.772133609
+VOTE/tstcluster/OCRFILE/REGISTRY.255.772207785
+CRS/tstcluster/OCRFILE/REGISTRY.255.772207425
+CRS/tstcluster/ASMPARAMETERFILE/REGISTRY.253.772208263
+CRS/tstcluster/spfileASM.ora# /u01/app/11.2.0/grid/bin/crsctl stop cluster -all
CRS-2673: Attempting to stop 'ora.crsd' on 'lnxora01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'lnxora01'
.
# /u01/app/11.2.0/grid/bin/crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'lnxora01'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'lnxora02'
.
$ asmcmd spget
+CRS/tstcluster/spfileASM.ora
SQL> ! srvctl stop diskgroup -g crstmp -n lnxora02,lnxora02
SQL> drop diskgroup crstmp including contents;
Diskgroup dropped.
SQL>
FILES_OF_CLUSTER
------------------------------------------------------------
+CRS/tstcluster/OCRFILE/REGISTRY.255.772207425
+CRS/tstcluster/ASMPARAMETERFILE/REGISTRY.253.772211229
+CRS/tstcluster/spfileASM.ora
+VOTE/tstcluster/OCRFILE/REGISTRY.255.772207785