CentOS下Apache Doris Oracle ODBC外表使用指南
阿新 • • 發佈:2022-04-12
1.軟體環境
- 作業系統:CentOS 7.8
- Apache Doris :0.15
- Postgresql資料庫:oracle 19c
- UnixODBC:2.3.1
- Oracle ODBC :instantclient-odbc-linux.x64-19.13.0.0.0dbru
2.Oracle安裝部署
因為是測試沒有Oracle的環境,由於安裝比較繁瑣耗時,所以通過Docker進行快速安裝部署,下面給出各個版本的Docker映象地址
2.1 Oracle 21C
# 從Docker hub下載,網路不好時,一般比較慢 docker pull lhrbest/oracle21c_ee_db_21.3.0.0 # 可以選擇從阿里雲下載 docker pull registry.cn-hangzhou.aliyuncs.com/lhrbest/oracle21c_ee_db_21.3.0.0 # 從阿里雲下載後可以tag成如下形式 docker tag registry.cn-hangzhou.aliyuncs.com/lhrbest/oracle21c_ee_db_21.3.0.0 lhrbest/oracle21c_ee_db_21.3.0.0
啟動容器
# 1、建立容器 docker run -d --name lhroracle21c -h lhroracle21c \ -p 5510:5500 -p 55100:5501 -p 1530:1521 -p 3400:3389 \ -v /sys/fs/cgroup:/sys/fs/cgroup \ --privileged=true lhrbest/oracle21c_ee_db_21.3.0.0 \ /usr/sbin/init # 2、進入容器 docker exec -it lhroracle21c bash # 3、啟動監聽和資料庫 su - oracle sas startup lsnrctl start
2.2 Oracle 19C
請參照:https://mp.weixin.qq.com/s/R5o3BQwj7q68OyYJg1JUjQ
2.3 Oracle 18C
## 拉取映象
docker pull registry.cn-hangzhou.aliyuncs.com/zhengqing/oracle18c
## 執行容器
docker run -d --name oracle18c -p 1521:1521 registry.cn-hangzhou.aliyuncs.com/zhengqing/oracle18c
2.4 Oracle 12C
##拉取映象 docker pull quay.io/maksymbilenko/oracle-12c ##執行容器 docker run -d -p 8080:8080 -p 1521:1521 -v /my/oracle/data:/u01/app/oracle quay.io/maksymbilenko/oracle-12c
2.5 Oracle 11g
##拉取映象
docker pull registry.cn-hangzhou.aliyuncs.com/helowin/oracle_11g
##執行容器
docker run -d -p 1521:1521 --name oracle11g registry.cn-hangzhou.aliyuncs.com/helowin/oracle_11g
3.安裝unixODBC驅動
首先我們安裝unixODBC驅動、這裡直接給出驅動的安裝命令
yum install unixODBC unixODBC-devel libtool-ltdl libtool-ltdl-devel
安裝完成之後執行odbcinst -j
,看到下面資訊說明安裝成功
#odbcinst -j
unixODBC 2.3.1
DRIVERS............: /etc/odbcinst.ini
SYSTEM DATA SOURCES: /etc/odbc.ini
FILE DATA SOURCES..: /etc/ODBCDataSources
USER DATA SOURCES..: /root/.odbc.ini
SQLULEN Size.......: 8
SQLLEN Size........: 8
SQLSETPOSIROW Size.: 8
4.安裝Oracle ODBC驅動及測試
4.1 安裝驅動
我們需要下載下面這幾個安裝包:
oracle-instantclient19.13-basic-19.13.0.0.0-2.x86_64.rpm
oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
下面是下載地址:
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-basic-19.13.0.0.0-2.x86_64.rpm
然後執行安裝上面四個包
rpm -ivh oracle-instantclient19.13-basic-19.13.0.0.0-2.x86_64.rpm
rpm -ivh oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
rpm -ivh oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm
rpm -ivh oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
驗證我們安裝的ODBC驅動動態連結庫是否正確
root@iZbp1cq4g9n8chsy7hcafhZ:~/doris/be/conf# ldd /usr/lib/oracle/19.13/client64/lib/libsqora.so.19.1
linux-vdso.so.1 (0x00007ffefef27000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f43e80b0000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f43e7f61000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f43e7f3e000)
libnsl.so.1 => /lib/x86_64-linux-gnu/libnsl.so.1 (0x00007f43e7f21000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f43e7f16000)
libaio.so.1 => /lib/x86_64-linux-gnu/libaio.so.1 (0x00007f43e7f11000)
libresolv.so.2 => /lib/x86_64-linux-gnu/libresolv.so.2 (0x00007f43e7ef3000)
libclntsh.so.19.1 => /usr/lib/oracle/19.13/client64/lib/libclntsh.so.19.1 (0x00007f43e3d6f000)
libclntshcore.so.19.1 => /usr/lib/oracle/19.13/client64/lib/libclntshcore.so.19.1 (0x00007f43e37cb000)
libodbcinst.so.2 => /usr/local/lib/libodbcinst.so.2 (0x00007f43e37b3000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f43e35c1000)
/lib64/ld-linux-x86-64.so.2 (0x00007f43e8379000)
libnnz19.so => /usr/lib/oracle/19.13/client64/lib/libnnz19.so (0x00007f43e2f4a000)
libltdl.so.7 => /lib/x86_64-linux-gnu/libltdl.so.7 (0x00007f43e2f3d000)
4.2 配置環境變數
sudo vi ~/.bashrc
加入下面的內容
export ORACLE_HOME=/usr/lib/oracle/19.13/client64
export TNS_ADMIN=$ORACLE_HOME/network/admin
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export ORACLE_SID=LEI
export PATH=$ORACLE_HOME/bin:$PATH
4.3 配置tnsnames.ora檔案
cd /usr/lib/oracle/19.13/client64
mkdir -p network/admin
vi tnsnames.ora
加入下面的內容(注意修改成自己的,這裡是示例)
demo =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.28.7.211)(PORT = 1521))
)
(CONNECT_DATA =
( SERVICE_NAME = LEI)
)
)
注意
- 將HOST、PORT換成你自己的
- SERVICE_NAME :這個是我們啟動Oracle docker的時候設定的ORACLE_SID
4.4 配置odbcinst.ini
這裡使用RPM包安裝的額ODBC驅動動態連結庫在 /usr/lib/oracle/19.13/client64/lib/
目錄下
root@iZbp1cq4g9n8chsy7hcafhZ:~/instantclient_21_4# ll /usr/lib/oracle/19.13/client64/lib/
total 236232
drwxr-xr-x 3 root root 4096 Jan 2 11:04 ./
drwxr-xr-x 5 root root 4096 Jan 1 19:47 ../
-rw-r--r-- 1 root root 342 Nov 27 02:41 glogin.sql
lrwxrwxrwx 1 root root 21 Jan 1 19:43 libclntshcore.so -> libclntshcore.so.19.1*
-rwxr-xr-x 1 root root 8057664 Nov 27 02:39 libclntshcore.so.19.1*
lrwxrwxrwx 1 root root 17 Jan 1 19:43 libclntsh.so -> libclntsh.so.19.1*
lrwxrwxrwx 1 root root 17 Jan 1 19:43 libclntsh.so.10.1 -> libclntsh.so.19.1*
lrwxrwxrwx 1 root root 17 Jan 1 19:43 libclntsh.so.11.1 -> libclntsh.so.19.1*
lrwxrwxrwx 1 root root 17 Jan 1 19:43 libclntsh.so.12.1 -> libclntsh.so.19.1*
lrwxrwxrwx 1 root root 17 Jan 1 19:43 libclntsh.so.18.1 -> libclntsh.so.19.1*
-rwxr-xr-x 1 root root 81679160 Nov 27 02:39 libclntsh.so.19.1*
-rwxr-xr-x 1 root root 3642520 Nov 27 02:39 libipc1.so*
-rwxr-xr-x 1 root root 478728 Nov 27 02:39 libmql1.so*
-rwxr-xr-x 1 root root 5831752 Nov 27 02:39 libnnz19.so*
-rwxr-xr-x 1 root root 2342024 Nov 27 02:39 libocci.so.19.1*
-rwxr-xr-x 1 root root 130543568 Nov 27 02:39 libociei.so*
-rwxr-xr-x 1 root root 153464 Nov 27 02:39 libocijdbc19.so*
-rwxr-xr-x 1 root root 116376 Nov 27 02:39 liboramysql19.so*
-rwxr-xr-x 1 root root 1660776 Nov 27 02:41 libsqlplusic.so*
-rwxr-xr-x 1 root root 1572432 Nov 27 02:41 libsqlplus.so*
-rwxr-xr-x 1 root root 1070192 Nov 27 02:41 libsqora.so.19.1* ---這裡是要使用的ODBC動態連結庫
drwxr-xr-x 3 root root 4096 Jan 1 19:43 network/
-rw-r--r-- 1 root root 4355723 Nov 27 02:39 ojdbc8.jar
-rw-r--r-- 1 root root 313026 Nov 27 02:41 ottclasses.zip
-rw-r--r-- 1 root root 37519 Nov 27 02:39 xstreams.jar
編輯/etc/odbcinst.ini,在最後加上下面的內容
[Oracle 19 ODBC driver]
Description = Oracle ODBC driver for Oracle 19
Driver = /usr/lib/oracle/19.13/client64/lib/libsqora.so.19.1
Setup =
FileUsage =
CPTimeout =
CPReuse =
配置odbc.ini,在最後加上下面的內容
[oracle]
Driver = Oracle 19 ODBC driver ---這裡的名稱是上面odbcinst.ini裡oracle部分用[]括起來的內容
ServerName =172.16.192.81:1521/LEI --這裡是你的oracle資料ip地址,埠及SID
UserID = C##dbuser --這裡是我們上面建立的使用者名稱
Password = zhangfeng --密碼
驗證ODBC
isql oracle
+---------------------------------------+
| Connected! |
| |
| sql-statement |
| help [tablename] |
| quit |
| |
+---------------------------------------+
顯示一切正常
5.Apache Doris Oracle外表驗證
5.1 修改配置
修改BE節點conf/odbcinst.ini檔案,加入剛才/etc/odbcinst.ini新增的一樣內容,並刪除原先的Oracle配置,加上你剛才安裝的,如下:
[Oracle 19 ODBC driver]
Description = Oracle ODBC driver for Oracle 19
Driver = /usr/lib/oracle/19.13/client64/lib/libsqora.so.19.1
5.2 驗證
建立oracle的ODBC Resource
CREATE EXTERNAL RESOURCE `oracle_19`
PROPERTIES (
"host" = "172.16.192.81",
"port" = "1521",
"user" = "C##dbuser",
"password" = "zhangfeng",
"database" = "LEI", --這裡是你的資料庫示例名稱,也就是我們在docker啟動時的ORACLE_SID
"driver" = "Oracle 19 ODBC driver", ---這裡的名稱一定和你在be odbcinst.ini裡的oracle部分的[]裡的內容一樣,重要
"odbc_type" = "oracle",
"type" = "odbc_catalog"
);
建立ODBC外表
CREATE EXTERNAL TABLE `oracle_odbc` (
person_id int,
first_name VARCHAR(50) NOT NULL,
last_name VARCHAR(50) NOT NULL
) ENGINE=ODBC
COMMENT "ODBC"
PROPERTIES (
"odbc_catalog_resource" = "oracle_19",
"database" = "LEI",
"table" = "persons"
);
下面我們看執行結果
mysql> CREATE EXTERNAL RESOURCE `oracle_19`
-> PROPERTIES (
-> "host" = "172.16.192.81",
-> "port" = "1521",
-> "user" = "C##dbuser",
-> "password" = "zhangfeng",
-> "database" = "LEI",
-> "driver" = "Oracle 19 ODBC driver",
-> "odbc_type" = "oracle",
-> "type" = "odbc_catalog"
-> );
Query OK, 0 rows affected (0.01 sec)
mysql>
mysql> CREATE EXTERNAL TABLE `oracle_odbc` (
-> person_id int,
-> first_name VARCHAR(50) NOT NULL,
-> last_name VARCHAR(50) NOT NULL
-> ) ENGINE=ODBC
-> COMMENT "ODBC"
-> PROPERTIES (
-> "odbc_catalog_resource" = "oracle_19",
-> "database" = "LEI",
-> "table" = "persons"
-> );
Query OK, 0 rows affected (0.01 sec)
mysql> select * from oracle_odbc;
+-----------+------------+-----------+
| person_id | first_name | last_name |
+-----------+------------+-----------+
| 1 | zhang | feng |
| 2 | 張峰 | 峰 |
| 3 | zhangfeng | 峰值 |
+-----------+------------+-----------+
3 rows in set (0.06 sec)
OK一切正常,正常情況下,Oracle ODBC驅動只要你的資料庫版本和你的ODBC驅動版本(大版本號對上就行)一致,就基本不會出問題。
6.Oracle 各個版本和ODBC驅動程式的對應關係
這個同樣適用於Ubuntu作業系統下
Oracle版本 | Oracle ODBC版本 |
---|---|
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production | oracle-instantclient19.13-odbc-19.13.0.0.0 |
Oracle Database 12c Standard Edition Release 12.2.0.1.0 - 64bit Production | oracle-instantclient19.13-odbc-19.13.0.0.0 |
Oracle Database 18c Enterprise Edition Release 18.0.0.0.0 - Production | oracle-instantclient19.13-odbc-19.13.0.0.0 |
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production | oracle-instantclient19.13-odbc-19.13.0.0.0 |
Oracle Database 21c Enterprise Edition Release 21.0.0.0.0 - Production | oracle-instantclient19.13-odbc-19.13.0.0.0 |
Oracle ODBC驅動版本下載地址:
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-sqlplus-19.13.0.0.0-2.x86_64.rpm
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-devel-19.13.0.0.0-2.x86_64.rpm
https://download.oracle.com/otn_software/linux/instantclient/1913000/oracle-instantclient19.13-odbc-19.13.0.0.0-2.x86_64.rpm