文章目录


客户端安装sqoop

1、上传下载的 sqoop 软件并解压

sqoop与mysql-client的部署_大数据

hadoop@ddai-desktop:~$ cd /opt/
hadoop@ddai-desktop:/opt$ sudo tar xzvf /home/hadoop/sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz 
hadoop@ddai-desktop:/opt$ sudo chown -R hadoop:hadoop sqoop-1.4.7.bin__hadoop-2.6.0/

2、解压sqoop压缩包并修改属性

3、修改sqoop配置参数

hadoop@ddai-desktop:/opt/sqoop-1.4.7.bin__hadoop-2.6.0/conf$ vim sqoop-env-template.sh
export HADOOP_COMMON_HOME=/opt/hadoop-2.8.5
export HADOOP_MAPRED_HOME=/opt/hadoop-2.8.5

export HBASE_HOME=/opt/hbase-2.2.6

export HIVE_HOME=/opt/apache-hive-2.3.6-bin

export HCAT_HOME=/opt/apache-hive-2.3.6-bin/hcatalog 

export ZOOCFGDIR=/opt/apache-zookeeper-3.5.8-bin

修改配置文件名字

sqoop与mysql-client的部署_mysql_02

4、修改环境变量并生效

hadoop@ddai-desktop:~$ vim /home/hadoop/.profile 
hadoop@ddai-desktop:~$ source /home/hadoop/.profile

sqoop与mysql-client的部署_mysql_03

5、上传 mysql-connector-java-5.1.48.jar

传到 sw-desktop 节点机的/app/sqoop-1.4.7.bin__hadoop-2.6.0/lib 目录下

sqoop与mysql-client的部署_hadoop_04

安装mysql-client软件包

1、客户端安装mysql-client软件

查询 mysql-client 软件是否安装

hadoop@ddai-desktop:~$ dpkg-query -l mysql-client

安装 mysql-client 软件

hadoop@ddai-desktop:~$ sudo apt install mysql-client

2、在主节点上对mysql用户授权

hadoop@ddai-master:~$ sudo mysql -uroot -p123456

mysql> create user 'sqoop'@'%' identified by 'Dai@123456';
mysql> grant all privileges on *.* to 'sqoop'@'%';

mysql> create user 'sqoop'@'localhost' identified by 'Dai@123456';
mysql> grant all privileges on *.* to 'sqoop'@'localhost';

3、客户端上创建数据

hadoop@ddai-desktop:~$ mysql -hddai-master -usqoop -pDai@123456
mysql> create database sqoop;
Query OK, 1 row affected (0.01 sec)

mysql> use sqoop;
Database changed
mysql> create table dept(id int,name varchar(20),primary key(id));
Query OK, 0 rows affected (0.02 sec)

mysql> insert into dept values(1245,'云计算');
Query OK, 1 row affected (0.01 sec)

mysql> insert into dept values(3545,'大数据');
Query OK, 1 row affected (0.00 sec)

mysql> insert into dept values(3512,'物联网');
Query OK, 1 row affected (0.01 sec)

mysql> select * from dept;
+------+-----------+
| id   | name      |
+------+-----------+
| 1245 | 云计算    |
| 3512 | 物联网    |
| 3545 | 大数据    |
+------+-----------+
3 rows in set (0.00 sec)

mysql> quit
Bye