Sqoop-1.4.6安装部署

版权声明:本文为博主原创文章,未经博主允许不得转载。 https://blog.csdn.net/S630730701/article/details/79765546

部署的前提是已经存在HADOOP、HBASE、HIVE、ZOOKEEPER环境

(1)下载地址:sqoop-1.4.6

解压到/home/sqoop/sqoop1.4

(2)、配置环境变量在:/etc/profiles 文件中添加下面内容

#sqoop 

export SQOOP_HOME=/home/sqoop/sqoop1.4

export PATH=$PATH:$SQOOP_HOME/bin

(3)、修改sqoop配置文件

复制sqoop1.4/conf/sqoop-env-template.sh为sqoop-env.sh

命令: cp  $SQOOP_HOME/conf/sqoop-env-template.sh     $SQOOP_HOME/conf/sqoop-env.sh

添加相关的配置 (只需把sqoop-env.sh中#号去掉然后把=右边填上对应的路径就行了,分别是HADOOP,HBASE,HIVE,ZOOKEEPER的主目录)

#Setpath to where bin/hadoop is available

export HADOOP_COMMON_HOME=/home/hadoop/hadoop

#Setpath to where hadoop-*-core.jar isavailable

expor tHADOOP_MAPRED_HOME=/home/hadoop/hadoop

#setthe path to where bin/hbase isavailable

export HBASE_HOME=/home/hbase/hbase 

#Setthe path to where bin/hive is available

export HIVE_HOME= /home/hive/hive

#Setthe path for where zookeper config diris

export ZOOCFGDIR= /home/zookeeper/zookeeper

(4)、测试Sqoop

发现有警告

修改$SQOOP_HOME/bin/configure-sqoop

注释掉HCatalog,Accumulo检查(除非你准备使用HCatalog,Accumulo等HADOOP上的组件) 

## Moved to be a runtime check in sqoop.

#if [ ! -d "${HCAT_HOME}" ]; then

# echo "Warning: $HCAT_HOME does not exist! HCatalog jobs willfail."

# echo 'Please set $HCAT_HOME to the root of your HCatalog installation.'

#fi

#if [ ! -d "${ACCUMULO_HOME}" ];then

# echo "Warning: $ACCUMULO_HOME does not exist! Accumulo imports willfail."

# echo 'Please set $ACCUMULO_HOME to the root of your Accumuloinstallation.'

#fi 

再次执行sqoop version

18/03/31 09:13:28 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.5.2

Sqoop 1.4.6-cdh5.5.2

查看某一个命令的使用说明:

$ sqoopimport --help

$ sqoophelp import

猜你喜欢

转载自blog.csdn.net/S630730701/article/details/79765546