1. 程式人生 > >Sqoop-1.4.6安裝部署

Sqoop-1.4.6安裝部署

部署的前提是已經存在HADOOP、HBASE、HIVE、ZOOKEEPER環境

(1)下載地址:sqoop-1.4.6

解壓到/home/sqoop/sqoop1.4

(2)、配置環境變數在:/etc/profiles 檔案中新增下面內容

#sqoop 

export SQOOP_HOME=/home/sqoop/sqoop1.4

export PATH=$PATH:$SQOOP_HOME/bin

(3)、修改sqoop配置檔案

複製sqoop1.4/conf/sqoop-env-template.sh為sqoop-env.sh

命令: cp  $SQOOP_HOME/conf/sqoop-env-template.sh     $SQOOP_HOME/conf/

sqoop-env.sh

新增相關的配置 (只需把sqoop-env.sh中#號去掉然後把=右邊填上對應的路徑就行了,分別是HADOOP,HBASE,HIVE,ZOOKEEPER的主目錄)

#Setpath to where bin/hadoop is available

export HADOOP_COMMON_HOME=/home/hadoop/hadoop

#Setpath to where hadoop-*-core.jar isavailable

expor tHADOOP_MAPRED_HOME=/home/hadoop/hadoop

#setthe path to where bin/hbase isavailable

export HBASE_HOME=/home/hbase/hbase 

#Setthe path to where bin/hive is available

export HIVE_HOME= /home/hive/hive

#Setthe path for where zookeper config diris

export ZOOCFGDIR= /home/zookeeper/zookeeper

(4)、測試Sqoop

發現有警告

修改$SQOOP_HOME/bin/configure-sqoop

註釋掉HCatalog,Accumulo檢查(除非你準備使用HCatalog,Accumulo等HADOOP上的元件) 

## Moved to be a runtime check in sqoop.

#if [ ! -d "${HCAT_HOME}" ]; then

# echo "Warning: $HCAT_HOME does not exist! HCatalog jobs willfail."

# echo 'Please set $HCAT_HOME to the root of your HCatalog installation.'

#fi

#if [ ! -d "${ACCUMULO_HOME}" ];then

# echo "Warning: $ACCUMULO_HOME does not exist! Accumulo imports willfail."

# echo 'Please set $ACCUMULO_HOME to the root of your Accumuloinstallation.'

#fi 

再次執行sqoop version

18/03/31 09:13:28 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.5.2

Sqoop 1.4.6-cdh5.5.2

檢視某一個命令的使用說明:

$ sqoopimport --help

$ sqoophelp import