clickhouse叢集安裝部署文件
阿新 • • 發佈:2022-03-10
clickhouse 叢集安裝部署文件
一、環境準備
CentOS系統三臺測試機
Host: 192.168.2.211、 192.168.2.212、 192.168.2.213
二、RPM安裝包安裝
# 前提需要zookeeper環境,如沒有需要安裝(因為之前就有,所以就講解如何搭建kafka叢集) # 分別在三臺機器上root使用者下安裝clickhouse-server、clickhouse-client sudo yum install -y yum-utils sudo yum-config-manager --add-repo https://packages.clickhouse.com/rpm/clickhouse.repo sudo yum install -y clickhouse-server clickhouse-client
三、配置
clickhouse-server、clickhouse-client version 21.12.2.17
單機版
1、修改clickhouse-server的配置檔案config.xml
[clickhouse@node2 clickhouse-server]$ vim /etc/clickhouse-server/config.xml
<!--因為9000埠被其他服務佔用,故把埠tcp埠修改1200,為了之後管理方便就把相關的埠號都改成一個範圍內的埠號,方便後期維護使用--> <!-- Port for HTTP API. See also 'https_port' for secure connections. This interface is also used by ODBC and JDBC drivers (DataGrip, Dbeaver, ...) and by most of web interfaces (embedded UI, Grafana, Redash, ...). --> <!--http網址訪問埠--> <http_port>1199</http_port> <!-- Port for interaction by native protocol with: - clickhouse-client and other native ClickHouse tools (clickhouse-benchmark, clickhouse-copier); - clickhouse-server with other clickhouse-servers for distributed query processing; - ClickHouse drivers and applications supporting native protocol (this protocol is also informally called as "the TCP protocol"); See also 'tcp_port_secure' for secure connections. --> <!--clickhouse-client客戶端監聽埠--> <tcp_port>1200</tcp_port> <!-- Compatibility with MySQL protocol. ClickHouse will pretend to be MySQL for applications connecting to this port. --> <!--監聽mysql埠--> <mysql_port>1201</mysql_port> <!-- Compatibility with PostgreSQL protocol. ClickHouse will pretend to be PostgreSQL for applications connecting to this port. --> <postgresql_port>1202</postgresql_port> <!-- Port for communication between replicas. Used for data exchange. It provides low-level data access between servers. This port should not be accessible from untrusted networks. See also 'interserver_http_credentials'. Data transferred over connections to this port should not go through untrusted networks. See also 'interserver_https_port'. --> <interserver_http_port>1203</interserver_http_port> ... ... ... <!--將註釋掉的這行放開,作用是可以通過遠端伺服器訪問服務--> <listen_host>::</listen_host> ... ... ... <!--將原始的全部註釋掉--> <!-- <remote_servers> --> <!-- Test only shard config for testing distributed storage --> <!-- <test_shard_localhost> --> <!-- Inter-server per-cluster secret for Distributed queries default: no secret (no authentication will be performed) If set, then Distributed queries will be validated on shards, so at least: - such cluster should exist on the shard, - such cluster should have the same secret. And also (and which is more important), the initial_user will be used as current user for the query. Right now the protocol is pretty simple and it only takes into account: - cluster name - query Also it will be nice if the following will be implemented: - source hostname (see interserver_http_host), but then it will depends from DNS, it can use IP address instead, but then the you need to get correct on the initiator node. - target hostname / ip address (same notes as for source hostname) - time-based security tokens --> <!-- <secret></secret> --> <!-- <shard> --> ... ... <!--</remote_servers>-->
修改到此處單機版的clickhouse就安裝完成了。可以測試啟動clickhouse-server 和clickhouse-client
啟動clickhouse-server
[root@master ~]# systemctl start clickhouse-server [root@master ~]# systemctl status clickhouse-server ● clickhouse-server.service - ClickHouse Server (analytic DBMS for big data) Loaded: loaded (/etc/systemd/system/clickhouse-server.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2022-03-10 17:13:21 CST; 6min ago Main PID: 12290 (clckhouse-watch) CGroup: /system.slice/clickhouse-server.service ├─12290 clickhouse-watchdog --config=/etc/clickhouse-server/config.xml --pid-file=/run/clickhouse-server/clickhouse-server.pid └─12291 /usr/bin/clickhouse-server --config=/etc/clickhouse-server/config.xml --pid-file=/run/clickhouse-server/clickhouse-server.pid Mar 10 17:13:21 master systemd[1]: Started ClickHouse Server (analytic DBMS for big data). Mar 10 17:13:21 master systemd[1]: Starting ClickHouse Server (analytic DBMS for big data)... Mar 10 17:13:21 master clickhouse-server[12290]: Processing configuration file '/etc/clickhouse-server/config.xml'. Mar 10 17:13:21 master clickhouse-server[12290]: Logging trace to /var/log/clickhouse-server/clickhouse-server.log Mar 10 17:13:21 master clickhouse-server[12290]: Logging errors to /var/log/clickhouse-server/clickhouse-server.err.log Mar 10 17:13:22 master clickhouse-server[12290]: Processing configuration file '/etc/clickhouse-server/config.xml'. Mar 10 17:13:22 master clickhouse-server[12290]: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/config.xml'. Mar 10 17:13:22 master clickhouse-server[12290]: Processing configuration file '/etc/clickhouse-server/users.xml'. Mar 10 17:13:22 master clickhouse-server[12290]: Saved preprocessed configuration to '/var/lib/clickhouse/preprocessed_configs/users.xml'. #看到active(running)就證明 serve啟動完成 systemctl start clickhouse-server #啟動 systemctl status clickhouse-server #狀態 systemctl stop clickhouse-server #停止
啟動clickhouse-client
#接著啟動client
#因為我在config.xml的配置檔案修改過<tcp_port>, 故在啟動的時候需要指定新的port
[root@master ~]# clickhouse-client --port 1200
ClickHouse client version 21.11.7.9 (official build).
Connecting to localhost:1200 as user default.
Connected to ClickHouse server version 21.11.7 revision 54450.
master :)
#到此處就client也啟動成功了
叢集版
在單機版的基礎上新增以下配置
1、修改clickhouse-server的配置檔案config.xml
<!--新增-->
<!--ck叢集節點-->
<remote_servers>
<!-- 叢集名稱,可以修改-->
<test_ck_cluster>
<!-- 配置三個分片, 每個分片對應一臺機器, 為每個分片配置一個副本 -->
<!--分片1-->
<shard>
<!-- 權重:新增一條資料的時候有多大的概率落入該分片,預設值:1 -->
<weight>1</weight>
<internal_replication>true</internal_replication>
<replica>
<host>192.168.1.211</host>
<port>1200</port>
<user>default</user>
<password></password>
<compression>true</compression>
</replica>
</shard>
<!--分片2-->
<shard>
<weight>1</weight>
<internal_replication>true</internal_replication>
<replica>
<host>192.168.1.212</host>
<port>1200</port>
<user>default</user>
<password></password>
<compression>true</compression>
</replica>
</shard>
<!--分片3-->
<shard>
<weight>1</weight>
<internal_replication>false</internal_replication>
<replica>
<host>192.168.1.213</host>
<port>1200</port>
<user>default</user>
<password></password>
<compression>true</compression>
</replica>
</shard>
</test_ck_cluster>
</remote_servers>
<!--zookeeper相關配置-->
<zookeeper>
<node index="1">
<host>192.168.1.211</host>
<port>2181</port>
</node>
<node index="2">
<host>192.168.1.212</host>
<port>2181</port>
</node>
<node index="3">
<host>192.168.1.213</host>
<port>2181</port>
</node>
</zookeeper>
<macros>
<replica>192.168.1.211</replica> <!--當前節點主機名-->
</macros>
<networks>
<ip>::/0</ip>
</networks>
<!--壓縮相關配置-->
<clickhouse_compression>
<case>
<min_part_size>10000000000</min_part_size>
<min_part_size_ratio>0.01</min_part_size_ratio>
<method>lz4</method> <!--壓縮演算法lz4壓縮比zstd快, 更佔磁碟-->
</case>
</clickhouse_compression>
三個節點配置檔案的區別
<!-- 每臺機器對應各自的主機名 -->
<macros>
<replica>192.168.1.211</replica> <!--當前節點主機名-->
</macros>
全部配置完成後,分別各自啟動每個節點的clickhouse-server
然後隨機在一臺機器上啟動client進行測試
測試語句
select cluster,shard_num,replica_num,host_name,port,user from system.clusters;
結果
[root@master ~]# clickhouse-client --port
Bad arguments: the required argument for option '--port' is missing
[root@master ~]# clickhouse-client --port 1200
ClickHouse client version 21.11.7.9 (official build).
Connecting to localhost:1200 as user default.
Connected to ClickHouse server version 21.11.7 revision 54450.
master :) select cluster,shard_num,replica_num,host_name,port,user from system.clusters;
SELECT
cluster,
shard_num,
replica_num,
host_name,
port,
user
FROM system.clusters
Query id: 32df1583-7cf0-4e16-b1f4-13506797925c
┌─cluster─────────┬─shard_num─┬─replica_num─┬─host_name─────┬─port─┬─user────┐
│ test_ck_cluster │ 1 │ 1 │ 192.168.1.211 │ 1200 │ default │
│ test_ck_cluster │ 2 │ 1 │ 192.168.1.212 │ 1200 │ default │
│ test_ck_cluster │ 3 │ 1 │ 192.168.1.213 │ 1200 │ default │
└─────────────────┴───────────┴─────────────┴───────────────┴──────┴─────────┘
3 rows in set. Elapsed: 0.001 sec.
master :)
可以看到叢集的資訊了 就OK了。