使用oracle 11g 的direct nfs 存放資料檔案
Oracle11gR2中已經集成了direct nfs driver,而在此之前是沒有改驅動的
也就是說在11gR2中,經過簡單設定之後,就能直接利用其他NAS儲存裝置了。
和傳統的nfs比,好處是提高了效能和配置的簡便性.
下面簡要描述一下direct nfs 的配置過程。
環境如下:兩臺linux5.5
其中:一臺安裝oracle11gR2,也是nfs client (IP:192.168.133.11,NAME:edbj2p1
一臺nfs server (IP:192.168.133.12,NAME:edbj2p2) ;
伺服器端共享的目錄: /vol/oradata
客戶端掛載點:/u02/oradata/prod1
建立的表空間:shared_data
1.配置服務端edbj2p2
[[email protected] ~]# echo '/vol/oradata 192.168.133.11(rw,no_root_squash,insecure)' >> /etc/exports
注意:這裡一定要加 insecure,否則,無法正常使用dnfs
[[email protected] ~]# exportfs -arv
[[email protected] ~]# service nfs restart
--確定服務端的nfs共享
[[email protected] ~]# showmount -e edbj2p2
Export list for edbj2p2:
/vol/oradata 192.168.133.11
2.配置客戶端edbj2p1
2.1 確定
[[email protected] ~]# service portmap status
portmap (pid 3540) is running...
2.2先確認在客戶端機器可以看到伺服器端共享出來的nfs
[[email protected] ~]# showmount -e edbj2p2
Export list for edbj2p2:
/vol/oradata 192.168.133.11
2.3調整libodm11.so檔案
[[email protected] ~]$ cd $ORACLE_HOME/lib
[[email protected] lib]$ pwd
/u01/app/oracle/product/11.2.0/dbhome_1/lib
--修改libodm11.so,使用libnfsodm11.so
[[email protected] lib]$ mv libodm11.so libodm11.so.bak
[[email protected] lib]$ ln -s libnfsodm11.so libodm11.so
或者 一條命令搞定:
make -f ins_rdbms.mk dnfs_on
確認一下
[[email protected] lib]$ ls -ltr libodm*
-rw-r--r-- 1 oracle oinstall 5266 Sep 18 2011 libodm11.a
-rw-r--r-- 1 oracle oinstall 8957 Sep 18 2011 libodmd11.so
lrwxrwxrwx 1 oracle oinstall 12 Feb 5 16:05 libodm11.so.bak -> libodmd11.so
lrwxrwxrwx 1 oracle oinstall 14 Feb 6 11:39 libodm11.so -> libnfsodm11.so
2.4 建立oranfstab檔案
--進入$ORACLE_HOME/dbs目錄
[[email protected] lib]$ cd $ORACLE_HOME/dbs
[[email protected] dbs]$ pwd
/u01/app/oracle/product/11.2.0/dbhome_1/dbs
--建立 oranfstab
[[email protected] dbs]$ touch oranfstab
[[email protected] dbs]$ echo 'server:edbj2p2' >> oranfstab
[[email protected] dbs]$ echo 'path:192.168.133.12' >> oranfstab
[[email protected] dbs]$ echo 'export: /vol/oradata mount: /u02/oradata/prod1' >> oranfstab
其中:server:edbj2p2 代表nfs server的hostname
path:192.168.133.12 代表nfs server的IP
export: /vol/oradata 代表伺服器端的目錄
mount: /u02/oradata/prod1 代表nfs client上的目錄
--在客戶端事先建好目錄
[[email protected] ~]# mkdir -p /u02/oradata/prod1
[[email protected] ~]# chown -R oracle:oinstall /u02/oradata/prod1
[[email protected] ~]# chmod -R 775 /u02/oradata/prod1
3.載入nfs (在客戶端操作)
3.1 直接載入nfs
mount -t nfs edbj2p2:/vol/oradata /u02/oradata/prod1
3.2 永久生效,需要修改/etc/fstab
192.168.133.12:/vol/oradata /u02/oradata/prod1 nfs defaults 0 0
3.3 檢查掛載結果
[[email protected]edbj2p1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
...
192.168.133.12:/vol/oradata
16G 2.8G 12G 20% /u02/oradata/prod1
4.dnfs生效 (在客戶端操作)
只有重起資料庫,才能生效
sqlplus /nolog
sql>startup force
檢查資料庫日誌,有以下記錄:
...
diagnostic_dest = "/u01/app/oracle/product/11.2.0/dbhome_1"
Oracle instance running with ODM: Oracle Direct NFS ODM Library Version 3.0
Mon Feb 06 14:35:54 2017
...
Direct NFS: attempting to mount /vol/oradata on filer edbj2p2 defined in oranfstab
Direct NFS: channel config is:
channel id [0] local path [192.168.133.12]
Direct NFS: mount complete dir /vol/oradata on edbj2p2 mntport 854 nfsport 2049
Direct NFS: channel id [0] path [192.168.133.12] to filer [edbj2p2] via local is UP
Direct NFS: channel id [1] path [192.168.133.12] to filer [edbj2p2] via local is UP
5.在dnfs上建立表空間 (在客戶端操作)
create tablespace SHARED_DATA datafile '/u02/oradata/prod1/shared_data01.dbf' size 10m;
題外話:
create tablespace SHARED_DATA datafile '/u02/oradata/prod1/shared_data01.dbf' size 10m
Direct NFS: please check that oradism is setuid
如果後端報這個錯,需要設定setuid
chown root oradism
chmod u+s oradism
6.驗證:
6.1 v$dnfs_servers中,svrname應該是oranfstab中的server後面的專案
col dirname for a13
col SVRNAME for a10
select * from v$dnfs_servers;
1* select * from v$dnfs_servers
ID SVRNAME DIRNAME MNTPORT NFSPORT WTMAX RTMAX
1 edbj2p2 /vol/oradata 854 2049 32768 32768
6.2 資料檔案使用情況
col filename for a40
select * from V$DNFS_FILES
FILENAME FILESIZE PNUM SVR_ID
/u02/oradata/prod1/shared_data01.dbf 10493952 10 1
6.3 dnfs通道情況
col path for a20
col local for a10
set line 200
select * from V$DNFS_CHANNELS
PNUM SVRNAME PATH LOCAL CH_ID SVR_ID SENDS RECVS PINGS
10 edbj2p2 192.168.133.12 0 1 0 0 0
10 edbj2p2 192.168.133.12 1 1 0 0 0
11 edbj2p2 192.168.133.12 0 1 0 0 0
11 edbj2p2 192.168.133.12 1 1 0 0 0
30 edbj2p2 192.168.133.12 0 1 0 0 0
6.4 伺服器端埠連線情況:
[[email protected] oradata]# netstat -an |grep 2049
tcp 0 0 0.0.0.0:2049 0.0.0.0:* LISTEN
tcp 0 0 192.168.133.12:2049 192.168.133.11:20295 ESTABLISHED
tcp 0 0 192.168.133.12:2049 192.168.133.11:51581 ESTABLISHED
tcp 0 0 192.168.133.12:2049 192.168.133.11:690 ESTABLISHED
tcp 0 0 192.168.133.12:2049 192.168.133.11:36340 ESTABLISHED
tcp 0 0 192.168.133.12:2049 192.168.133.11:15344 ESTABLISHED
udp 0 0 0.0.0.0:2049 0.0.0.0:*