1. 程式人生 > 其它 >Hadoop的HA(ZooKeeper)安裝與部署

Hadoop的HA(ZooKeeper)安裝與部署

非HA的步驟:

https://www.cnblogs.com/live41/p/15467263.html

一、部署設定

1.伺服器

c1 192.168.100.105 zk、namenode、zkfc、datanode、nodemanager
c2 192.168.100.110 zk、namenode、zkfc、datanode、nodemanager、resourcemanager、journalnode
c3 192.168.100.115 zk、datanode、nodemanager、resourcemanager、journalnode
c4 192.168.100.120 zk、datanode、nodemanager、resourcemanager、journalnode

2.目錄

hadoop namenode目錄 /home/hadoop/hdfs/name
hadoop datanode目錄 /home/hadoop/hdfs/data
hadoop臨時目錄 /home/hadoop/tmp
zookeeper資料目錄 /home/zookeeper/data/
zookeeper日誌目錄 /home/zookeeper/logs/

二、系統配置

跟下面文章的第二點一樣

https://www.cnblogs.com/live41/p/15467263.html

三、下載及配置環境變數

1.下載及解壓

https://downloads.apache.org/hadoop/common/

http://zookeeper.apache.org/releases.html

解壓到/home/目錄

2.配置環境變數

vim ~/.bashrc

在末尾加入以下內容:

export HADOOP_HOME=/home/hadoop
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:/home/zookeeper/bin

export HADOOP_COMMON_HOME=/home/hadoop
export HADOOP_HDFS_HOME=/home/hadoop
export HADOOP_MAPRED_HOME=/home/hadoop
export HADOOP_CONF_DIR=/home/hadoop/etc/hadoop

export HDFS_DATANODE_USER
=root export HDFS_NAMENODE_USER=root export HDFS_SECONDARYNAMENODE_USER=root export YARN_HOME=/home/hadoop export YARN_RESOURCEMANAGER_USER=root export YARN_NODEMANAGER_USER=root

三、安裝和配置ZooKeeper

1.建立data和logs目錄

mkdir -pv /home/zookeeper/{data,logs} 

2.編輯zoo.cfg

cd /home/zookeeper/conf
cp zoo_sample.cfg zoo.cfg
vim zoo.cfg

修改屬性或新增內容:

tickTime=2000
initLimit=10
syncLimit=5
clientPort=2181

dataDir=/home/zookeeper/data/
dataLogDir=/home/zookeeper/logs

server.1=c1:2888:3888
server.2=c2:2888:3888
server.3=c3:2888:3888
server.4=c4:2888:3888