Sqoop 安装和测试

选择一台服务器（安装过 hive 的服务器 node2,node3 都可以）这里我们选择 node3 安装 sqoop

1. 上传:将 sqoop 安装包上传到 node3 的/opt/apps 目录
2. 解压并改名

[root@node3 opt]# mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha/ sqoop-1.4.6

3. 配置环境变量

[root@node3 opt]# vim /etc/profile 
export SQOOP_HOME=/opt/sqoop-1.4.6 
export PATH=$PATH:......:$SQOOP_HOME/bin 
[root@node3 opt]# source /etc/profile

4. 添加数据库驱动包 mysql-connector-java-5.1.26-bin.jar将它上传到 node3:/opt/sqoop-1.4.6/lib

[root@node3 apps]# cp mysql-connector-java-5.1.26-bin.jar /opt/sqoop-1.4.6/lib/

5. 通过 sqoop 命令查询对应 mysql 数据下所有的数据库实例：

[root@node3 sqoop-1.4.6]# sqoop help list-databases

[root@node3 apps]# sqoop list-databases --connect jdbc:mysql://node1:3306/ --username root --password 123456

[root@node3 apps]# sqoop list-databases --connect jdbc:mysql://node1:3306/ --username root --password 123456
21/11/25 17:40:55 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
21/11/25 17:40:55 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
21/11/25 17:40:55 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
information_schema
hive
hive_ha
hive_remote
mysql
performance_schema
result_db
sys

访问mysql成功
将 sqoop 的命令放到文件中：sqoop1.txt

list-databases
--connect
jdbc:mysql://node1:3306/
--username
root
--password
123456

命令行执行：

[root@node3 ~]# sqoop --options-file sqoop1.txt
21/11/25 17:51:54 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
21/11/25 17:51:54 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
21/11/25 17:51:55 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
information_schema
hive
hive_ha
hive_remote
mysql
performance_schema
result_db
sys