技術標籤：hadoopsqoop

sqoop1.4.7相容hadoop2.6以上所有版本

1 下載並解壓

1）下載地址：http://mirrors.hust.edu.cn/apache/sqoop

2）上傳安裝包sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz到伺服器

3）解壓sqoop安裝包

 tar -zxf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz

4)新增環境變數

2 修改配置檔案

1) 進入到/opt/module/sqoop/conf目錄，重新命名配置檔案

 mv sqoop-env-template.sh sqoop-env.sh

2) 修改配置檔案

vi sqoop-env.sh 

增加如下內容

export HADOOP_COMMON_HOME=/root/software/hadoop-3.2.1
export HADOOP_MAPRED_HOME=/root/software/hadoop-3.2.1

3 拷貝JDBC驅動

下載jar包可以去https://mvnrepository.com/maven倉庫進行下載

1）將mysql-connector-java-8.0.16.jar拷貝jdbc驅動到sqoop的lib目錄下

4.修改配置檔案

在bin目錄下修改configure-sqoop，修改掉對hbase和ZOOKEEPER的驗證

## Moved to be a runtime check in sqoop.
#if [ ! -d "${HBASE_HOME}" ]; then
# echo "Warning: $HBASE_HOME does not exist! HBase imports will fail."
#  echo 'Please set $HBASE_HOME to the root of your HBase installation.'
#fi
 

#if [ ! -d "${ZOOKEEPER_HOME}" ]; then
#  echo "Warning: $ZOOKEEPER_HOME does not exist! Accumulo imports will fail."
#  echo 'Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.'
#fi

5.可能會報錯，說是Stringutils沒找到

下載並匯入commons-lang-2.6.jar包即可

6.測試執行

bin/sqoop list-tables --connect jdbc:mysql://10.9.1.139:3306/cluster?serverTimezone=UTC --username root --password a