[sqoop] sqoop 1.4.7 installation integration cdh5.13

Preface

Use apache sqoop Integrate CDH5.13.

One 、 download

Download address : http://archive.apache.org/dist/sqoop/

Connections used here ：

http://archive.apache.org/dist/sqoop/1.4.7/sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz

Two 、 install

1. decompression

tar -xzvf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz -C /home/rong/

2. rename

mv sqoop-1.4.7.bin__hadoop-2.6.0 sqoop-1.4.7

3. Soft connection

ln -s sqoop-1.4.7 sqoop

4. Configure environment variables

vim /etc/profile

Add the following ：

export SQOOP_HOME=/home/rong/sqoop-1.4.7
export PATH=$SQOOP_HOME/bin:$PATH

5. To configure conf

a. Change file name

cp ${SQOOP_HOME}/conf/sqoop-env-template.sh sqoop-env.sh

b. Modify file content

vi sqoop-env.sh

Set the following ：

#Set path to where bin/hadoop is available
#
export HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH/lib/hadoop

#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH/lib/hadoop-yarn

#set the path to where bin/hbase is available
export HBASE_HOME=/opt/cloudera/parcels/CDH/lib/hbase

#Set the path to where bin/hive is available
export HIVE_HOME=/opt/cloudera/parcels/CDH/lib/hive
export HIVE_CONF_DIR=/etc/hive/conf

#Set the path for where zookeper config dir is
export ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH/lib/zookeeper
export ZOOCFGDIR=/etc/zookeeper/conf/  
                                           

If it works CDH colony , Then this basically does not need to be changed

6. Copy jar package

cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-exec.jar /home/rong/sqoop/lib/
cp /opt/cloudera/parcels/CDH/lib/hive/lib/hive-common.jar /home/rong/sqoop/lib/
cp /opt/cloudera/parcels/CDH/lib/hadoop/hadoop-common.jar /home/rong/sqoop/lib/

verification

${SQOOP_HOME}/bin/sqoop-version