Cloudera Manager安裝之Cloudera Manager安裝前準備(Ubuntu14.04)(一)
其實,基本思路跟如下差不多,我就不多詳細說了,貼出主要圖。
博主,我是直接借鑑下面這位博主,來進行安裝的!(灰常感謝他們!)
https://www.zybuluo.com/ncepuwanghui/note/474966
ClouderManager官網
https://www.cloudera.com/documentation/manager/5-1-x/Cloudera-Manager-Installation-Guide/cm5ig_mysql.html#id_trn_pps_xm_unique_1
說在前面的話
我的機器是總共4臺,分別為ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。
在ubuntucmbigdata1上執行了
sudo apt-get install cloudera-manager-daemons cloudera-manager-server sudo apt-get install cloudera-manager-daemons cloudera-manager-agent
即,ubuntucmbigdata1是既做server,又做agent。
在ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4上執行了
sudo apt-get install cloudera-manager-daemons cloudera-manager-agent
即,ubuntucmbigdata2、3、和4是隻做agent。
在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上
新建檔案sudo vi /etc/apt/sources.list.d/cloudera-manager.list
,複製以下內容到cloudera.list裡
# Packages for Cloudera Manager, Version 5, on Ubuntu 14.04 x86_64 deb [arch=amd64] http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contribdeb-src http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib
並且在在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上
向apt新增cloudera源公鑰,在所有節點執行如下命令:
curl -s http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/archive.key | sudo apt-key add -
然後,再sudo apt-get update
具體在後面我會詳細教大家怎麼安裝。
的確,我也跟這位博主一樣,也需要在實驗室裡部署。以及也是4臺機器。(至於原因,大家都懂得,中國高校研究生喜歡4、3、2、1來進行加速比做實驗論文)
在實驗室安裝過社群版的Hadoop,當時用的是普通PC機,安裝的過程遇到了好多問題。當解決了大部分的安裝問題之後由於實驗室的需求,需要安裝一個商業發行版的hadoop ,我們就採用的Cloudera 公司發行的版本。首先要說明的是CDH對記憶體要求比較高,當我們採用原來的4G記憶體的PC機,只要啟動基本記憶體就滿了,並且會拖慢整個叢集的運算速度。所以說安裝CDH對硬體的要求比較高。安裝CDH 有三種安裝方式:線上安裝、半離線安裝、離線安裝。線上安裝和離線安裝我都安裝過,雖然線上安裝貌似簡單但是實際用起來還是沒有離線安裝方便,我還是建議大家採用離線安裝的方式。不過下面都會介紹線上安裝的方式和離線安裝的方式。希望對別人有所幫助
其它的,ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。
參考 第一步:
參考
在檔案末尾(按快捷鍵,Shift + g)新增bigdata ALL=(ALL) NOPASSWD:ALL
ctrl+o 儲存
ctrl+x 退出。
最後,得到如下
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
防火牆
參考
由此,表明Ubuntu14.04是預設沒開啟防火牆的。
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
相關服務的安裝
如果沒有安裝的話可以使用下面的命令安裝一下。
參考
[email protected]:~$ sudo apt-get install lrzsz [email protected]:~$ sudo apt-get install openssh-server
這個工具要裝(你懂得),2個理由:1,可以遠端管理系統。2,Cloudera Manages 叢集管理需要用該服務。
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
ssh 服務配置、vim的安裝
參考
開啟sshd_config檔案, 在 /etc/ssh 目錄下。
# Authentication: LoginGraceTime 120 #PermitRootLogin without-password PermitRootLogin yes StrictModes yes
註釋掉 #PermitRootLogin without-password 行。
新增 PermitRootLogin yes 行
修改後,如下:
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
修改hosts檔案
vi /etc/hosts
在裡面新增主機名和IP之間的對應關係
#127.0.1.1 ubuntucmbigdata1 192.168.86.31 ubuntucmbigdata1 192.168.86.32 ubuntucmbigdata2 192.168.86.33 ubuntucmbigdata3 192.168.86.34 ubuntucmbigdata4
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
主機名
[email protected]:~$ sudo vim /etc/hostname [email protected]:~$ sudo vim /etc/hostname
[email protected]:~$ sudo vim /etc/hostname
[email protected]:~$ sudo vim /etc/hostname
這裡肯定是對的。
配置ssh免密碼登入 (對於這一步,其實可以不做,因為,在CM時會自動安裝,大家可以跳過)
見
[email protected]:~$ mkdir .ssh [email protected]:~$ ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/home/bigdata/.ssh/id_rsa):(回車) Enter passphrase (empty for no passphrase):(回車) Enter same passphrase again: (回車) Your identification has been saved in /home/bigdata/.ssh/id_rsa. Your public key has been saved in /home/bigdata/.ssh/id_rsa.pub. The key fingerprint is: 58:c2:3f:25:cb:82:5b:d5:b4:b2:ea:54:ac:e2:ea:c8 [email protected] The key's randomart image is: +--[ RSA 2048]----+ | . | | . o . | | o = + | | . O * | | . + S | | o = . | | o + | |.. . + | |.Eo.. . | +-----------------+ [email protected]:~$ cd .ssh [email protected]:~/.ssh$ cat id_rsa.pub >> authorized_keys [email protected]:~/.ssh$ cd .. [email protected]:~$ chmod 700 .ssh [email protected]:~$ chmod 600 .ssh/* [email protected]:~$ ssh ubuntucmbigdata1 The authenticity of host 'ubuntucmbigdata1 (127.0.1.1)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1' (ECDSA) to the list of known hosts. Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) * Documentation: https://help.ubuntu.com/ New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jun 25 14:45:01 2017 from 192.168.86.1 [email protected]:~$ exit; logout Connection to ubuntucmbigdata1 closed. [email protected]:~$ ssh ubuntucmbigdata1 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) * Documentation: https://help.ubuntu.com/ New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jun 25 15:52:15 2017 from localhost [email protected]:~$ exit;
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
將所有節點(ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4)中的共鑰id_ras.pub拷貝到ubuntucmbigdata1中的authorized_keys檔案中。
[email protected]:~$ cat ~/.ssh/id_rsa.pub | ssh [email protected] 'cat >> ~/.ssh/authorized_keys' The authenticity of host 'ubuntucmbigdata1 (192.168.86.31)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1,192.168.86.31' (ECDSA) to the list of known hosts. [email protected]'s password: [email protected]:~$
[email protected]:~$ cat ~/.ssh/id_rsa.pub | ssh [email protected] 'cat >> ~/.ssh/authorized_keys' The authenticity of host 'ubuntucmbigdata1 (192.168.86.31)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1,192.168.86.31' (ECDSA) to the list of known hosts. [email protected]'s password: [email protected]:~$
[email protected]:~$ cat ~/.ssh/id_rsa.pub | ssh [email protected] 'cat >> ~/.ssh/authorized_keys' The authenticity of host 'ubuntucmbigdata1 (192.168.86.31)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1,192.168.86.31' (ECDSA) to the list of known hosts. [email protected]'s password: [email protected]:~$
得到
[email protected]:~$ cd .ssh [email protected]:~/.ssh$ ls authorized_keys id_rsa id_rsa.pub known_hosts [email protected]:~/.ssh$ cat authorized_keys ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCrEPrX5HHQCnwWoavXUoM8N+fINUckzZ7EcDjJqs1EYkrzltdmMrKQv9VeGGj2BPaGoxzmgit+DPFGuPmPgftBOPWQnLVoILqtQd+H5m0wrK67W7Y98cUpZ+0thCbnmUZRuAES1mt2xS/bL2ibw8AvRrd6HUHOhH17Tcd/2gok32ximn48kPzs6li5d2ay8rPqgqD3QQw3NlAhVmK7RVmpsvlHCTnhrQIoNCz8A+adtK5r1jSgH7uKmPAJTqMUP2Zgv02XQTf/kjW3eacNAWR96Khdh0HsktaK6HuC+FFC+8bXqAj4Hih25EX8RTMFMl3nhGT5FPMLyt7C0Z65QhKV [email protected] ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDi7mZhUMzB1h7XjWPIZo3w/Tps0Oxr3mgOeKVfoD4pme/lzgTz61FpEmgggc2WB+mNLKSG/WiazTzuSXKUdBXnM5LNeCGV3ZcWBxFrwp2+wAYH6L5wOGqRq+oQzKUHIsvqEc7TBpN3JmaqZOw4zVCwRBBzQ4cg1B2SjSsjDFLBpjlfM+N8UDG+g9OaZDlEu1z5oUyz0KsKbBtvkkSott+sB+EX4zYSDz/cwUPmSf76RJLk89AI8aX4wGS+P4Eahs5/J2wfLOnAWBG2NQoYVPKyN4sXj7OWw+aErriUJXOqLayYV5xSM2yJjT9WuzbNOiR/D7HGZBlC4wXWG+11GdO5 [email protected] ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZtE7Z4cXPjv/t0bC4Ozi3HuovI6XiNe+tJ7cQ6WKp/m44a8w/FqgB4HVZLLQusuXwQM/mEzHKiL1EdPsi5om/s7A7xyDakl2OSUOqki871+/TSjFVTUOOz/H/wwHvl2QzBkb8/dMZLphU1/E4odrFhhlhGGpjK5WUdY8cYH6yyli6W3oDPZ55UG+8EnM89T1AyhC1E81xmyMzGMCj4603oZFwckOeff5n2dqeXg0CRhXO9HhsF9kSZQnE2GmR5pLZlORMkitsCKIhaf5UOBzrGENeJylHGCV1F+KlYjQ0ND4ufTUq14aAnUwBOCqCMhB1tBOBGI4O3S0+j27xumwN [email protected] ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXPtqzCU+AmRi+l5lysCEG8gbFKPItYjczvSZIe6+arOfgE/3Ozu2cwr9MABTjgd80hk7ZG4YNRxBPxKvXKtcZxGAe6poe1G5UOrlKOMLeqv1mnUiwtRVsiWp0qnPFcmMt17mpCyN7XnCOLTsdTcl+BVl0c2S2i1xoC6vRKvqV1C/nneJUmuD3KRR1zmR3+a9Wj4yhRRahO6ro/LhgqdwrEaR+NOuT+/1d058fXANToaqyUMa72pz5M2kdxZprumzmHAJ5KlOYImlGrahdLk1wPFckA2m1BMKKycxZHFm1X1O9HeSFrD9N+pdtZY1CXdc6N9hmWKzjBDqw71rZgdUd [email protected] [email protected]:~/.ssh$
說明成功!
然後將中ubuntucmbigdata1的authorized_keys檔案分發到所有節點上面。
[email protected]:~/.ssh$ scp -r authorized_keys [email protected]:~/.ssh/ The authenticity of host 'ubuntucmbigdata2 (192.168.86.32)' can't be established. ECDSA key fingerprint is 17:a2:fb:1e:47:dc:79:d5:2d:5a:aa:79:9b:10:c2:eb. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata2,192.168.86.32' (ECDSA) to the list of known hosts. [email protected]'s password: authorized_keys 100% 1624 1.6KB/s 00:00 [email protected]:~/.ssh$ scp -r authorized_keys [email protected]:~/.ssh/ The authenticity of host 'ubuntucmbigdata3 (192.168.86.33)' can't be established. ECDSA key fingerprint is 6a:32:65:61:98:78:3f:ad:08:2c:f3:a1:bc:c6:c4:91. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata3,192.168.86.33' (ECDSA) to the list of known hosts. [email protected]'s password: authorized_keys 100% 1624 1.6KB/s 00:00 [email protected]:~/.ssh$ scp -r authorized_keys [email protected]:~/.ssh/ The authenticity of host 'ubuntucmbigdata4 (192.168.86.34)' can't be established. ECDSA key fingerprint is f4:d5:92:17:dc:b1:8f:95:61:11:95:cd:d3:fa:2e:57. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata4,192.168.86.34' (ECDSA) to the list of known hosts. [email protected]'s password: authorized_keys 100% 1624 1.6KB/s 00:00 [email protected]:~/.ssh$
大家通過ssh 相互訪問,如果都能無密碼訪問,代表ssh配置成功。這裡很簡單,我就不多贅述了。
[email protected]:~$ ssh ubuntucmbigdata1 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) * Documentation: https://help.ubuntu.com/ New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jun 25 15:52:23 2017 from localhost [email protected]:~$ exit;Connection to ubuntucmbigdata1 closed. [email protected]:~$ ssh ubuntucmbigdata2 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) * Documentation: https://help.ubuntu.com/ New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jun 25 15:56:00 2017 from localhost [email protected]:~$ exit; logout Connection to ubuntucmbigdata2 closed. [email protected]:~$ ssh ubuntucmbigdata3 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) * Documentation: https://help.ubuntu.com/ New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jun 25 15:56:14 2017 from localhost [email protected]:~$ exit; logout Connection to ubuntucmbigdata3 closed. [email protected]:~$ ssh ubuntucmbigdata4 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64) * Documentation: https://help.ubuntu.com/ New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it. Last login: Sun Jun 25 15:56:27 2017 from localhost [email protected]:~$ exit; logout Connection to ubuntucmbigdata4 closed. [email protected]:~$
這樣,就說明是成功!
JDK的安裝(建議1.8)(對於這一步,其實可以不做,因為,在CM時會自動安裝,大家可以跳過)(但是要先解除安裝linux系統自帶的openjdk,因為自動也是安裝的是orcal公司的)
見
這裡,因為是ubuntu14.04版本,作為專業人員來說,
[email protected]:~$ sudo apt-get remove openjdk*
[email protected]:/usr/local$ pwd /usr/local [email protected]:/usr/local$ ll total 40 drwxr-xr-x 10 root root 4096 2月 18 2016 ./ drwxr-xr-x 10 root root 4096 2月 18 2016 ../ drwxr-xr-x 2 root root 4096 2月 18 2016 bin/ drwxr-xr-x 2 root root 4096 2月 18 2016 etc/ drwxr-xr-x 2 root root 4096 2月 18 2016 games/ drwxr-xr-x 2 root root 4096 2月 18 2016 include/ drwxr-xr-x 4 root root 4096 2月 18 2016 lib/ lrwxrwxrwx 1 root root 9 6月 24 15:00 man -> share/man/ drwxr-xr-x 2 root root 4096 2月 18 2016 sbin/ drwxr-xr-x 7 root root 4096 2月 18 2016 share/ drwxr-xr-x 2 root root 4096 2月 18 2016 src/ [email protected]:/usr/local$ sudo mkdir jdk [email protected]:/usr/local$ ll total 44 drwxr-xr-x 11 root root 4096 6月 25 16:08 ./ drwxr-xr-x 10 root root 4096 2月 18 2016 ../ drwxr-xr-x 2 root root 4096 2月 18 2016 bin/ drwxr-xr-x 2 root root 4096 2月 18 2016 etc/ drwxr-xr-x 2 root root 4096 2月 18 2016 games/ drwxr-xr-x 2 root root 4096 2月 18 2016 include/ drwxr-xr-x 2 root root 4096 6月 25 16:08 jdk/ drwxr-xr-x 4 root root 4096 2月 18 2016 lib/ lrwxrwxrwx 1 root root 9 6月 24 15:00 man -> share/man/ drwxr-xr-x 2 root root 4096 2月 18 2016 sbin/ drwxr-xr-x 7 root root 4096 2月 18 2016 share/ drwxr-xr-x 2 root root 4096 2月 18 2016 src/ [email protected]:/usr/local$ sudo chown -R bigdata:bigdata jdk/ [email protected]:/usr/local$ cd jdk/ [email protected]:/usr/local/jdk$ pwd /usr/local/jdk [email protected]:/usr/local/jdk$ sudo rz rz waiting to receive. [email protected]:/usr/local/jdk$ ll total 177000 drwxr-xr-x 2 bigdata bigdata 4096 6月 25 16:09 ./ drwxr-xr-x 11 root root 4096 6月 25 16:08 ../ -rw-r--r-- 1 root root 181238643 9月 3 2016 jdk-8u60-linux-x64.tar.gz [email protected]:/usr/local/jdk$ sudo tar -zxvf jdk-8u60-linux-x64.tar.gz
[email protected]:/usr/local/jdk$ ll total 177004 drwxr-xr-x 3 bigdata bigdata 4096 6月 25 16:09 ./ drwxr-xr-x 11 root root 4096 6月 25 16:08 ../ drwxr-xr-x 8 uucp 143 4096 8月 5 2015 jdk1.8.0_60/ -rw-r--r-- 1 root root 181238643 9月 3 2016 jdk-8u60-linux-x64.tar.gz [email protected]:/usr/local/jdk$ sudo rm jdk-8u60-linux-x64.tar.gz [email protected]:/usr/local/jdk$ sudo chown -R bigdata:bigdata jdk1.8.0_60/ [email protected]:/usr/local/jdk$ ll total 12 drwxr-xr-x 3 bigdata bigdata 4096 6月 25 16:10 ./ drwxr-xr-x 11 root root 4096 6月 25 16:08 ../ drwxr-xr-x 8 bigdata bigdata 4096 8月 5 2015 jdk1.8.0_60/ [email protected]:/usr/local/jdk$ sudo vim /etc/profile [email protected]:/usr/local/jdk$ sudo source /etc/profile sudo: source: command not found [email protected]:/usr/local/jdk$ source /etc/profile [email protected]:/usr/local/jdk$ java -version java version "1.8.0_60" Java(TM) SE Runtime Environment (build 1.8.0_60-b27) Java HotSpot(TM) 64-Bit Server VM (build 25.60-b23, mixed mode) [email protected]:/usr/local/jdk$
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
以及,我們還可以設定檔案開啟數量和用於最大程序數
檔案開啟數量
參考
[email protected]:~$ sudo vi /etc/security/limits.conf
* soft nofile 65535 * hard nofile 65535 * soft nproc 32000 * hard nproc 32000
我這裡,僅拿ubuntucmbigdata1來說,其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。
ubuntu系統的root使用者開啟
參考
[email protected]:~$ sudo -s [email protected]:~# pwd /home/bigdata [email protected]:~#
MySQL的安裝(以下步驟僅僅在ubuntucmbigdata1這臺機器上做)
注意:Cloudera-Manages-Server 端 需要安裝 MySQL,Cloudera-Manages-Agent 端 可以不裝。
即,在我這裡就是,Cloudera-Manages-Server 是cmbigdata1。同時,我也是喜歡把oozie、hive等這些,都是安裝在cmbigdata1這臺機器上。
Cloudera-Manages-Agent,在我這裡就是,cmbigdata2、cmbigdata3和cmbigdata4。
參考
[email protected]:~# apt-get install mysql-server
。。。 。。。 Setting up libdbd-mysql-perl (4.025-1ubuntu0.1) ... Setting up libterm-readkey-perl (2.31-1) ... Setting up mysql-client-5.5 (5.5.55-0ubuntu0.14.04.1) ... Setting up mysql-server-5.5 (5.5.55-0ubuntu0.14.04.1) ... 170625 16:28:33 [Warning] Using unique option prefix key_buffer instead of key_buffer_size is deprecated and will be removed in a future release. Please use the full name instead. 170625 16:28:33 [Note] Ignoring --secure-file-priv value as server is running with --bootstrap. 170625 16:28:33 [Note] /usr/sbin/mysqld (mysqld 5.5.55-0ubuntu0.14.04.1) starting as process 7930 ... mysql start/running, process 8062 Setting up libhtml-template-perl (2.95-1) ... Processing triggers for ureadahead (0.100.0-16) ... Setting up mysql-server (5.5.55-0ubuntu0.14.04.1) ... Processing triggers for libc-bin (2.19-0ubuntu6.7) ... [email protected]:~#
安裝成功!
啟動mysql服務
安裝MySql成功後,mysql服務會自動啟動
[email protected]:~# service mysql start
或者
[email protected]:~# sudo /etc/init.d/mysql start
安裝mysql JDBC驅動
[email protected]:~# apt-get install libmysql-java
設定MySQL的root使用者設定密碼,這一步,就不需要做了,在CentOS版本里,需要做。在Ubuntu版本,在安裝時,就已經設定了。
跳過,就是
建立Cloudera-Manages-Server 需要用到的資料庫表 for MySql。
Creating Databases for Activity Monitor, Reports Manager, Hive Metastore Server, Sentry Server, Cloudera Navigator AuditServer, and Cloudera Navigator Metadata Server
[email protected]:~# mysql -root -p Enter password: (密碼為rootroot) Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 42 Server version: 5.5.55-0ubuntu0.14.04.1 (Ubuntu) Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql>
執行建立資料庫指令碼語句。
mysql> create database hive DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive_password'; Ignoring query to other database mysql> grant all on *.* TO 'hive'@'ubuntucmbigdata1' IDENTIFIED BY 'hive_password'; Ignoring query to other database mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password'; Ignoring query to other database mysql> create database oozie DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on oozie.* TO 'oozie'@'localhost' IDENTIFIED BY 'oozie_password'; Ignoring query to other database mysql> grant all on *.* TO 'oozie'@'ubuntucmbigdata1' IDENTIFIED BY 'oozie_password'; Ignoring query to other database mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password'; Ignoring query to other database mysql> create database amon DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password'; Ignoring query to other database mysql> grant all on *.* TO 'amon'@'ubuntucmbigdata1' IDENTIFIED BY 'amon_password'; Ignoring query to other database mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password'; Ignoring query to other database mysql> create database smon DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on smon.* TO 'smon'@'localhost' IDENTIFIED BY 'smon_password'; Ignoring query to other database mysql> grant all on *.* TO 'smon'@'ubuntucmbigdata1' IDENTIFIED BY 'smon_password'; Ignoring query to other database mysql> grant all on smon.* TO 'smon'@'%' IDENTIFIED BY 'smon_password'; Ignoring query to other database mysql> create database rman DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password'; Ignoring query to other database mysql> grant all on *.* TO 'rman'@'ubuntucmbigdata1' IDENTIFIED BY 'rman_password'; Ignoring query to other database mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password'; Ignoring query to other database mysql> create database hmon DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on hmon.* TO 'hmon'@'localhost' IDENTIFIED BY 'hmon_password'; Ignoring query to other database mysql> grant all on *.* TO 'hmon'@'ubuntucmbigdata1' IDENTIFIED BY 'hmon_password'; Ignoring query to other database mysql> grant all on hmon.* TO 'hmon'@'%' IDENTIFIED BY 'hmon_password'; Ignoring query to other database mysql> create database nav DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password'; Ignoring query to other database mysql> grant all on *.* TO 'nav'@'ubuntucmbigdata1' IDENTIFIED BY 'nav_password'; Ignoring query to other database mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password'; Ignoring query to other database mysql>
mysql> flush privileges; Query OK, 0 rows affected (0.08 sec) mysql> select user,host,password from mysql.user; +------------------+------------------+-------------------------------------------+ | user | host | password | +------------------+------------------+-------------------------------------------+ | root | localhost | *6C362347EBEAA7DF44F6D34884615A35095E80EB | | root | ubuntucmbigdata1 | *6C362347EBEAA7DF44F6D34884615A35095E80EB | | root | 127.0.0.1 | *6C362347EBEAA7DF44F6D34884615A35095E80EB | | root | ::1 | *6C362347EBEAA7DF44F6D34884615A35095E80EB | | debian-sys-maint | localhost | *0C134AA3949C6DEE1804B1D1D641A7C2824C599A | | scm | % | *E2D6A4ADCCA7B38098E85EAF9BB785AB21451139 | | scm | ubuntucmbigdata1 | *E2D6A4ADCCA7B38098E85EAF9BB785AB21451139 | | scm | localhost | *E2D6A4ADCCA7B38098E85EAF9BB785AB21451139 | | hive | localhost | *8AC2E431CC7A9F2C4C0E51A65B8D8175892D9F22 | | hive | ubuntucmbigdata1 | *8AC2E431CC7A9F2C4C0E51A65B8D8175892D9F22 | | hive | % | *8AC2E431CC7A9F2C4C0E51A65B8D8175892D9F22 | | oozie | localhost | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 | | oozie | ubuntucmbigdata1 | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 | | oozie | % | *81A1BB46F79EBD0AA76E6EFAA31D62458CFCAF62 | | amon | localhost | *4A1243A12C2625553EC0465DD4E640DB056AA07A | | amon | ubuntucmbigdata1 | *4A1243A12C2625553EC0465DD4E640DB056AA07A | | amon | % | *4A1243A12C2625553EC0465DD4E640DB056AA07A | | smon | localhost | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 | | smon | ubuntucmbigdata1 | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 | | smon | % | *F65C49868BBCA6D143F5AF81D1864B1C64DF25B4 | | rman | localhost | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E | | rman | ubuntucmbigdata1 | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E | | rman | % | *AEF345BFE495D8E678EA9D3D5708FD110AD2F08E | | hmon | localhost | *DC736DB1383C5AC16BFE895C856F8D30214AF19A | | hmon | ubuntucmbigdata1 | *DC736DB1383C5AC16BFE895C856F8D30214AF19A | | hmon | % | *DC736DB1383C5AC16BFE895C856F8D30214AF19A | | nav | localhost | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 | | nav | ubuntucmbigdata1 | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 | | nav | % | *993A16D875A9AB1932CC2F57E7DADA76AD35C3B2 | +------------------+------------------+-------------------------------------------+ 29 rows in set (0.00 sec) mysql> exit;歡迎大家,加入我的微信公眾號:大資料躺過的坑 免費給分享
同時,大家可以關注我的個人部落格:
http://www.cnblogs.com/zlslch/ 和 http://www.cnblogs.com/lchzls/
人生苦短,我願分享。本公眾號將秉持活到老學到老學習無休止的交流分享開源精神,匯聚於網際網路和個人學習工作的精華乾貨知識,一切來於網際網路,反饋回網際網路。
目前研究領域:大資料、機器學習、深度學習、人工智慧、資料探勘、資料分析。 語言涉及:Java、Scala、Python、Shell、Linux等 。同時還涉及平常所使用的手機、電腦和網際網路上的使用技巧、問題和實用軟體。 只要你一直關注和呆在群裡,每天必須有收穫
以及對應本平臺的QQ群:161156071(大資料躺過的坑)
相關推薦
Cloudera Manager安裝之Cloudera Manager安裝前準備(CentOS6.5)(一)
Cloudera Manager安裝前準備 (一)機器準備 192.168.80.148 clouderamanager01 (部署ClouderaManager-server和Mirror server) (部署Agent) (分配1G,我這裡只是體驗
Cloudera Manager安裝之Cloudera Manager安裝前準備(Ubuntu14.04)(一)
其實,基本思路跟如下差不多,我就不多詳細說了,貼出主要圖。 博主,我是直接借鑑下面這位博主,來進行安裝的!(灰常感謝他們!) https://www.zybuluo.com/ncepuwanghui/note/474966 ClouderM
Ambari安裝之Ambari安裝前準備(CentOS6.5)(一)
優秀部落格 Ambari安裝前準備 (一)機器準備 192.168.80.144 ambari01 (部署Ambari-server和Mirror server) (分配1G,我這裡只是體驗過程,當然你可以分配更多或更小) 192.1
CentOS7.5利用Kubeadm安裝Kubernets(k8s)1.12.2(國內版)(一)
國內版 一、部署Kubernetes1.12.2(無dashboard) 1、所有節點部署docker-ce kubernetesyum源 阿里雲docker-ce地址 :https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo直接
Windows7下的Django環境、專案及工程搭建(包括anaconda安裝方法)(一)
我這也是邊學邊寫,大家一起吧。參考的資料有點多,但都不太完全,只能依據理解自己把它集合在一起。 首先,安裝python就不說了,我用的是anaconda,我在找了很久走了很多彎路之後才找到,這是一個python的科學環境,它很強大,集成了各種python所需要
抓包工具Fiddler下載 、安裝及對谷歌瀏覽器進行抓包使用(一)
一、Fiddler的安裝和配置 開啟工具Fiddler,在Tools選項裡面點選options 配置完後,重啟Fiddler 二、谷歌瀏覽器外掛SwitchyOmega的安裝使用 三、使用Fiddler對谷歌瀏覽器進行抓包
ELK日誌系統開發(Logstash、Elasticsearch、Kibana安裝)(一)
一、安裝Logstash !注意,logstash至少要有1G記憶體才能執行 在安裝Logstash之前,確保已經安裝了Java的執行環境 3)下載完成之後,加壓(無須編譯),並複製到local目錄下,這個是我正式部署的目錄:/usr/local/logstash-
教你用Cocosdx匯出安卓安裝檔案(.apk)(一)
我也是剛弄出來,過程可能有點混亂和不詳細,我盡我所能寫完整。各位看官多多包涵 裝置環境: 我所用的是mac 10.8.5 64位 Cocosdx-3.0rc2 xcode 5.0 一、準備
EntityFramework之數據庫以及表基本創建(一)
令行 代碼 client 建數據庫 通過 ted ble 另一個 www 前言 之前有學過EF一段時間那時EF才4.0似乎還不太穩定,而現在EF都已7.0版本,同時AspNet Identity都與此大有關聯,看來是大勢所趨於是開始學習EF,在學EF過程中也遇到一些小問題,
【SSH進階之路】Struts + Spring + Hibernate 進階開端(一)
height 一段 ioc 效率 陽光大道 面向對象的思想 text ase 們的 Long Long ago。就聽說過SSH。起初還以為是一個東東,詳細內容更是不詳,總認為高端大氣上檔次,經過學習之後才發現,不不過高大上,更是低調奢華有內涵,經過一段時間的
機器學習之numpy庫中常用的函數介紹(一)
做的 string idt 維度 數據 round float 數值 array 1. mat() mat()與array的區別: mat是矩陣,數據必須是2維的,是array的子集,包含array的所有特性,所做的運算都是針對矩陣來進行的。 array是數組,數據可以是多
吳恩達深度學習筆記(deeplearning.ai)之循環神經網絡(RNN)(一)
不同的 圖片 存在 最終 一個 har end markdown 輸入 1. RNN 首先思考這樣一個問題:在處理序列學習問題時,為什麽不使用標準的神經網絡(建立多個隱藏層得到最終的輸出)解決,而是提出了RNN這一新概念? 標準神經網絡如下圖所示: 標準神經網絡在解決序列
第二章之集成運算放大器的線性應用基礎(一)
+= 比例 com 作用 什麽是 開始 應用電路 ID 通過 第一章已經介紹了有關放大器的基本概念以及最重要的思想——負反饋思想。而第二章就開始介紹最重要的放大部件——集成運算放大器的性質和應用電路 分別從模型(基本電路),電壓傳輸特性(性質),線性和非線性運用(實踐)
資料新增非同步解析重新整理大資料量redis (——)(一)Java Collection之Queue佇列
Queue介面與List、Set同一級別,都是繼承了Collection介面。LinkedList實現了Queue接 口。Queue介面窄化了對LinkedList的方法的訪問許可權(即在方法中的引數型別如果是Queue時,就完全只能訪問Queue介面所定義的方法 了,而不能直接訪問 Linke
【SpringBoot學習之路】05.Springboot配置檔案詳解(一)
轉載宣告:商業轉載請聯絡作者獲得授權,非商業轉載請註明出處.原文來自 © 呆萌鍾【SpringBoot學習之路】05.Springboot配置檔案詳解(一) 配置檔案 Spring Boot使用一個全域性的配置檔案 applic
身份認證之PKI搭建、X.509(RFC5280)——(一)
身份認證之PKI搭建、X.509(RFC5280)——(一) 一.PKI的搭建 1.建立根CA 1.1建立目錄 1.2建立資料庫 1.3 生成Root CA請求 1.4生成Root CA證書
設計模式之建造者模式(Builder Pattern)(一)
建造者模式(Builder Pattern)使用多個簡單的物件一步一步構建成一個複雜的物件。這種型別的設計模式屬於建立型模式,它提供了一種建立物件的最佳方式。 一個 Builder 類會一步一步構造最終的物件。該 Builder 類是獨立於其他物件的。 意圖:將一個複雜的構建與其表示相分離,
演算法工程師修仙之路:吳恩達機器學習作業(一)
吳恩達機器學習筆記及作業程式碼實現中文版 第一個程式設計作業:單變數線性迴歸(python程式碼實現) 一元線性迴歸 問題描述 在本練習的這一部分中,您將使用只有單變數的線性迴歸方法預測餐車的利潤。 假設你是一家連鎖餐廳的執行長,正在
Django之模型層,單,多表操作(一)
一:資料庫型別 資料庫主要分成兩類,關係型資料庫和非關係型資料庫,具體區別可參照部落格地址,https://blog.csdn.net/u012965373/article/details/51779361。以下個人簡單理解 1:關係型資料庫: ORM 物件關係型對映。用物件的方式儲存資
深度學習之(神經網路)單層感知器(python)(一)
感知器介紹 感知器(Perceptron),是神經網路中的一個概念,在1950s由Frank Rosenblatt第一次引入。 單層感知器(Single Layer Perceptron)是最簡單的神經網路。它包含輸入層和輸出層,而輸入層和輸出層是直接相連的。