1. 程式人生 > >cdh版本的hive安裝以及配置

cdh版本的hive安裝以及配置

hive依賴hadoop

需要的軟體包:hive-0.13.1-cdh5.3.6.tar.gz 、hadoop-2.5.0-cdh5.3.6.tar.gz

1、hadoop的安裝步驟請訪問:

2、將hive軟體包上傳到Linux系統指定的目錄:/opt/softwares/cdh

3、解壓hive-0.13.1-cdh5.3.6.tar.gz到指定的目錄:/opt/modules/cdh/

  tar -zxvf hive-0.13.1-cdh5.3.6.tar.gz -C /opt/modules/cdh/

4、重新命名hive-env.sh (去掉.template)

HADOOP_HOME=/opt/modules/cdh/hadoop-2.5.0-cdh5.3.6


export HIVE_CONF_DIR=/opt/modules/cdh/hive-0.13.1-cdh5.3.6/conf

5、重新命名hive-site.xml (去掉.template,修改為site)

<property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>

<property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql://hadoop01.xningge.com:3306/cdhmetastore?createDatabaseIfNotExist=true</value>
</property>
<property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
</property>
<property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>xningge

</value>
</property>
<property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>???</value>
</property>

**注意:模板檔案有一個bug,在hive-site.xml的2781行少了一個<property>開始標記

6、重新命名hive-log4j.properties (去掉.template)

$ mkdir logs
** 修改hive-log4j.properties
hive.log.dir=/opt/modules/cdh/hive-0.13.1-cdh5.3.6/logs

7、拷貝jdbc driver

  ** 將驅動檔案複製到lib/
  $ cp /opt/software/mysql-connector-java-5.1.27-bin.jar lib/

8、切換到CDH Hadoop目錄,建立目錄,並修改許可權

  ** /user/hive/warehouse為Hive存放資料的目錄
  $ bin/hdfs dfs -mkdir -p /user/hive/warehouse
  $ bin/hdfs dfs -chmod g+w /user/hive/warehouse
  $ bin/hdfs dfs -chmod g+w /tmp

9、啟動客戶端使用Hive

  eg:把profile裡HIVE_HOME註解掉(如果有配置這個全域性變數的話,則註釋)

  $ bin/hive
  hive> show databases;