HDP-2.6.5 & ambari-2.6.2 安裝配置
阿新 • • 發佈：2018-12-13
mkdir 12c val HERE lean prior root mysql tools 安裝文件列表
* ambari.repo
* ambari-2.6.2.2-centos7.tar.gz
* hdp.repo
* HDP-2.6.5.0-centos7-rpm.tar.gz
* HDP-GPL-2.6.5.0-centos7-gpl.tar.gz
* HDP-UTILS-1.1.0.22-centos7.tar.gz
* apache-tomcat-8.5.27.tar.gz
* mysql-connector-java-5.1.46.tar.gz
自行至 https://hortonworks.com 下載部署環境
System： CentOS 7.x JDK: JDK-1.8.xxx Tomcat: Tomcat-8.5.27 (或者使用 Nginx、Httpd) MariaDB: MariaDB-5.5.60
集群角色
Ambari-Server: 10.0.2.20
Ambari-Agent01: 10.0.2.21
Ambari-Agent02: 10.0.2.22
cat >>/etc/hosts<<EOF
10.0.2.20 Ambari-Server server.ambari.com
10.0.2.21 Ambari-Agent01 agent01.ambari.com
10.0.2.22 Ambari-Agent02 agent02.ambari.com
EOF解決依賴
/usr/bin/yum install zlib zlib-devel libjpeg libjpeg-devel libpng libpng-devel gd gd-devel curl curl-devel freetype freetype-devel libxslt libxslt-devel libxml2 libxml2-devel ncurses ncurses-devel gcc gcc-c++ flex flex-devel libtiff-devel pam-devel libffi-devel e2fsprogs-devel openssl* ntpdate tree autoconf lrzsz uuid dstat bind-utils vim rsync net-tools wget -y 依賴問題根據自己服務器情況自行安裝，上述依賴是我的服務器基礎優化安裝的依賴包
配置JAVA環境
tar xf jdk-8u162-linux-x64.tar.gz -C /data/ cd /data;ln -s jdk1.8.0_162 jdk;cd cat >>/etc/profile<<EOF export JAVA_HOME=/data/jdk export JRE_HOME=\$\{JAVA_HOME\}/jre export CLASS_PATH=.:\$\{JAVA_HOME\}/lib:\$\{JRE_HOME\}/lib export PATH=\$\{JAVA_HOME\}/bin:\$\{JRE_HOME\}/bin:\$\{PATH\} EOF . /etc/profile
配置免密登陸
[root@Ambari-Server ~]$ ssh-keygen # 一路回車至結束
[root@Ambari-Server .ssh]$ ssh-copy-id 10.0.2.20
[root@Ambari-Server .ssh]$ for n in 21 22;do scp authorized_keys id_rsa id_rsa.pub 10.0.2.$n:/root/.ssh/;done
# 為去除‘yes‘輸入，執行下面的命令
[root@Ambari-Server ~]$ for n in Ambari-Server Ambari-Agent01 Ambari-Agent02 server.ambari.com agent01.ambari.com agent02.ambari.com;do ssh $n "uptime";done同步hosts文件
[root@Ambari-Server ~]$ for n in 21 22;do scp /etc/hosts 10.0.2.$n:/etc/;done安裝MariaDB
[root@Ambari-Server ~]$ yum install mariadb-server mariadb -y
添加配置 skip-name-resolve=on 到 /etc/my.cnf
[root@Ambari-Server ~]$ systemctl start mariadb.service
[root@Ambari-Server ~]$ mysqladmin -uroot password 123456
[root@Ambari-Server yum.repos.d]$ mysql -uroot -p123456 -e "create database ambari;"
[root@Ambari-Server yum.repos.d]$ mysql -uroot -p123456 -e "grant all privileges on ambari.* to ambari@‘localhost‘ identified by ‘123456‘;"
[root@Ambari-Server yum.repos.d]$ mysql -uroot -p123456 -e "grant all privileges on ambari.* to ambari@‘10.0.2.20‘ identified by ‘123456‘;"
[root@Ambari-Server yum.repos.d]$ mysql -uroot -p123456 -e "flush privileges;"安裝Tomcat
[root@Ambari-Server ~]$ tar xf apache-tomcat-8.5.27.tar.gz -C /data/
[root@Ambari-Server data]$ cd /data/;ln -s apache-tomcat-8.5.27 tomcat;cd
[root@Ambari-Server ~]$ tar xf mysql-connector-java-5.1.46.tar.gz
[root@Ambari-Server ~]$ mv mysql-connector-java-5.1.46/mysql-connector-java-5.1.46-bin.jar /data/tomcat/lib/
[root@Ambari-Server ~]$ mkdir /usr/share/java
[root@Ambari-Server ~]$ mv mysql-connector-java-5.1.46/mysql-connector-java-5.1.46.jar /usr/share/java/配置Ambari、HDP本地yum庫
[root@Ambari-Server hdp]$ rm -fr /data/tomcat/webapps/*
[root@Ambari-Server hdp]$ mkdir /data/tomcat/webapps/hdp/HDP-UTILS -p
[root@Ambari-Server conf]$ tar xf ambari-2.6.2.2-centos7.tar.gz -C /data/tomcat/webapps/hdp
[root@Ambari-Server conf]$ tar xf ambari-2.6.2.2-centos7.tar.gz -C /data/tomcat/webapps/hdp
[root@Ambari-Server conf]$ tar xf HDP-GPL-2.6.5.0-centos7-gpl.tar.gz -C /data/tomcat/webapps/hdp
[root@Ambari-Server conf]$ tar xf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /data/tomcat/webapps/hdp
[root@Ambari-Server conf]$ tar xf HDP-2.6.5.0-centos7-rpm.tar.gz -C /data/tomcat/webapps/hdp
[root@Ambari-Server conf]$ sed -i ‘112c<param-value>true</param-value>‘ web.xml
[root@Ambari-Server bin]$ /data/tomcat/bin/startup.sh
# 官方repo文件位置
[root@Ambari-Server 2.6.2.2-1]$ ll /data/tomcat/webapps/hdp/ambari/centos7/2.6.2.2-1/ambari.repo
-rw-r--r-- 1 root root 304 6月 12 2018 /data/tomcat/webapps/hdp/ambari/centos7/2.6.2.2-1/ambari.repo
[root@Ambari-Server 2.6.5.0-292]$ ll /data/tomcat/webapps/hdp/HDP/centos7/2.6.5.0-292/hdp.repo
-rw-r--r-- 1 root root 575 5月 15 2018 /data/tomcat/webapps/hdp/HDP/centos7/2.6.5.0-292/hdp.repo
[root@Ambari-Server 2.6.5.0-292]$ ll /data/tomcat/webapps/hdp/HDP-GPL/centos7/2.6.5.0-292/hdp-gpl.gpl.repo
-rw-r--r-- 1 root root 310 5月 15 2018 /data/tomcat/webapps/hdp/HDP-GPL/centos7/2.6.5.0-292/hdp-gpl.gpl.repo
[root@Ambari-Server 1.1.0.22]$ ll /data/tomcat/webapps/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/hdp-utils.repo
-rw-r--r-- 1 root root 197 5月 29 2018 /data/tomcat/webapps/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/hdp-utils.repo
# 參照官方repo文件，創建本地ambari.repo文件
[root@Ambari-Server yum.repos.d]$ cat >/etc/yum.repos.d/ambari.repo<<EOF
#VERSION_NUMBER=2.6.2.2-1
[ambari-2.6.2.2]
name=ambari Version - ambari-2.6.2.2
baseurl=http://Ambari-Server:8080/hdp/ambari/centos7/2.6.2.2-1
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/ambari/centos7/2.6.2.2-1/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
#VERSION_NUMBER=2.6.5.0-292
[HDP-2.6.5.0]
name=HDP Version - HDP-2.6.5.0
baseurl=http://Ambari-Server:8080/hdp/HDP/centos7/2.6.5.0-292
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/HDP/centos7/2.6.5.0-292/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://Ambari-Server:8080/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
#VERSION_NUMBER=2.6.5.0-292
[HDP-GPL-2.6.5.0]
name=HDP-GPL Version - HDP-GPL-2.6.5.0
baseurl=http://Ambari-Server:8080/hdp/HDP-GPL/centos7/2.6.5.0-292
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/HDP-GPL/centos7/2.6.5.0-292/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
EOF
# 同步ambari.repo至所有點節
[root@Ambari-Server yum.repos.d]$ for n in 21 22;do scp /etc/yum.repos.d/ambari.repo 10.0.2.$n:/etc/yum.repos.d/;done
# 更新yum cache
[root@Ambari-Server yum.repos.d]$ for n in 20 21 22;do ssh 10.0.2.$n "yum clean all";done
[root@Ambari-Server yum.repos.d]$ for n in 20 21 22;do ssh 10.0.2.$n "yum repolist";done安裝配置Ambari-Server
[root@Ambari-Server ~]$ yum install ambari-server -y
[root@Ambari-Server ambari-server]$ echo "client.api.port=9000" >>/etc/ambari-server/conf/ambari.properties
[root@Ambari-Server ~]$ echo "server.jdbc.driver.path=/data/tomcat/lib/mysql-connector-java-5.1.46-bin.jar" >>/etc/ambari-server/conf/ambari.properties
# 設置Ambari
[root@Ambari-Server ~]$ ambari-server setup
Using python /usr/bin/python
Setup ambari-server
Checking SELinux...
SELinux status is ‘disabled‘
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root):
Adjusting ambari-server permissions and ownership...
Checking firewall status...
Checking JDK...
Do you want to change Oracle JDK [y/n] (n)? y
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7
[3] Custom JDK
==============================================================================
Enter choice (1): 3
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /data/jdk
Validating JDK on Ambari Server...done.
Checking GPL software agreement...
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? y
Configuring database...
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL / MariaDB
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
[7] - BDB
==============================================================================
Enter choice (3): 3
Hostname (localhost):
Port (3306):
Database name (ambari):
Username (ambari):
Enter Database Password (123456):
Configuring ambari database...
Configuring remote database connection properties...
WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Proceed with configuring remote database connection properties [y/n] (y)?
Extracting system views...
ambari-admin-2.6.2.2.1.jar
...........
Adjusting ambari-server permissions and ownership...
Ambari Server ‘setup‘ completed successfully.
# 根據設置過程中的提示執行SQL
[root@Ambari-Server ~]$ mysql -uroot -p123456 -e "use ambari;source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql;"
[root@Ambari-Server ~]$ mysql -uroot -p123456 -e "show tables from ambari;"
# 啟動Ambari-server，因為systemctl沒有啟動信息輸出，不使用systemctl啟動
[root@Ambari-Server ambari-server]$ /etc/init.d/ambari-server start
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start..............................................
Server started listening on 9000
DB configs consistency check: no errors and warnings were found.
Ambari Server ‘start‘ completed successfully.安裝配置Ambari-agent
[root@Ambari-Server ~]$ for n in 20 21 22;do ssh 10.0.2.$n "yum install ambari-agent -y";done
[root@Ambari-Server conf]$ sed -i "s#hostname=localhost#hostname=Ambari-Server#" /etc/ambari-agent/conf/ambari-agent.ini
# 強制指定安全協議
[root@Ambari-Server conf]$ sed -i ‘/\[security\]/a\force_https_protocol=PROTOCOL_TLSv1_2‘ /etc/ambari-agent/conf/ambari-agent.ini
# 同步配置文件至所有節點
[root@Ambari-Server conf]$ for n in 21 22;do scp /etc/ambari-agent/conf/ambari-agent.ini 10.0.2.$n:/etc/ambari-agent/conf/;done
# 啟動所有節點Agent
[root@Ambari-Server conf]$ for n in 20 21 22;do ssh 10.0.2.$n "/etc/init.d/ambari-agent start";done頁面配置Ambari****
默認登陸權限：admin admin以下省略......
HDP-2.6.5 & ambari-2.6.2 安裝配置