Hadoop的HA(ZooKeeper)安裝與部署
非HA的步驟:
https://www.cnblogs.com/live41/p/15467263.html
一、部署設定
1.伺服器
c1 192.168.100.105 zk、namenode、zkfc、datanode、nodemanager
c2 192.168.100.110 zk、namenode、zkfc、datanode、nodemanager、resourcemanager、journalnode
c3 192.168.100.115 zk、datanode、nodemanager、resourcemanager、journalnode
c4 192.168.100.120 zk、datanode、nodemanager、resourcemanager、journalnode
2.目錄
hadoop namenode目錄 /home/hadoop/hdfs/name
hadoop datanode目錄 /home/hadoop/hdfs/data
hadoop臨時目錄 /home/hadoop/tmp
zookeeper資料目錄 /home/zookeeper/data/
zookeeper日誌目錄 /home/zookeeper/logs/
二、系統配置
跟下面文章的第二點一樣
https://www.cnblogs.com/live41/p/15467263.html
三、下載及配置環境變數
1.下載及解壓
https://downloads.apache.org/hadoop/common/
http://zookeeper.apache.org/releases.html
解壓到/home/目錄
2.配置環境變數
vim ~/.bashrc
在末尾加入以下內容:
export HADOOP_HOME=/home/hadoop export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:/home/zookeeper/bin export HADOOP_COMMON_HOME=/home/hadoop export HADOOP_HDFS_HOME=/home/hadoop export HADOOP_MAPRED_HOME=/home/hadoop export HADOOP_CONF_DIR=/home/hadoop/etc/hadoop export HDFS_DATANODE_USER=root export HDFS_NAMENODE_USER=root export HDFS_SECONDARYNAMENODE_USER=root export YARN_HOME=/home/hadoop export YARN_RESOURCEMANAGER_USER=root export YARN_NODEMANAGER_USER=root
三、安裝和配置ZooKeeper
1.建立data和logs目錄
mkdir -pv /home/zookeeper/{data,logs}
2.編輯zoo.cfg
cd /home/zookeeper/conf cp zoo_sample.cfg zoo.cfg vim zoo.cfg
修改屬性或新增內容:
tickTime=2000 initLimit=10 syncLimit=5 clientPort=2181 dataDir=/home/zookeeper/data/ dataLogDir=/home/zookeeper/logs server.1=c1:2888:3888 server.2=c2:2888:3888 server.3=c3:2888:3888 server.4=c4:2888:3888