环境准备
| 主机名 | IP | 系统 | HDFS |
|---|---|---|---|
| master | 192.168.154.135 | CentOS 7 | NameNode + DataNode + hive |
| slave1 | 192.168.154.139 | CentOS 7 | DataNode |
| slave2 | 192.168.154.140 | CentOS 7 | DataNode +SecondaryNamenode |
安装部署过程
一、必须先安装hadoop
参考博客 https://blog.51cto.com/u_13760351/3592055
二、安装mysql数据库，作为元数据库
1.可参考博客 https://blog.51cto.com/u_13760351/2497200
三、安装hive数据库：
Hive官网下载地址
http://archive.apache.org/dist/hive/
先将下载好的hive安装包上传到linux上
1.解压hive，
tar -zxvf apache-hive-1.2.1-bin.tar.gz -C /usr/local/
2.配置环境变量
vim /etc/profile
export HIVE_HOME=/usr/local/apache-hive-1.2.1
export PATH=$HIVE_HOME/bin:$PATH
3.刷新环境变量
source /etc/profile
4.配置hive-env.sh
vim hive-env.sh
export JAVA_HOME=/usr/local/java
export HADOOP_HOME=/usr/local/hadoop-2.7.2
export HIVE_CONF_DIR=/usr/local/apache-hive-1.2.1-bin/conf
4.配置hive-site.xml
vim hive-site.xml
<configuration>
<!--配置mysql的连接字符串-->
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://127.0.0.1:3306/hive?createDatabaseIfNotExist=true</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<!--配置mysql的连接驱动-->
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<!--配置登录mysql的用户-->
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>root</value>
<description>username to use against metastore database</description>
</property>
<!--配置登录mysql的密码-->
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>123456</value>
<description>password to use against metastore database</description>
</property>
</configuration>
5.添加mysql驱动,把包放进lib目录
cd /usr/local/apache-hive-1.2.1/lib
6.初始化
cd /usr/local/apache-hive-1.2.1/bin schematool -dbType mysql -initSchema
7.启动hive：
hive
**注：启动之前要启动hdfs **
bin/hive
进入后可以执行下面命令进行操作
show databases; #查看数据库 show tables; #查看表
