利用Nginx反向代理 Tomcat 多节点
实验说明：通过两台nginx反代理和 keepalived实现双机热备并成功访问后端商城项目数据。
实验所需
两台nginx keepalived 漂移地址 192.168.30.100
Nginx 192.168.30.34
192.168.30.36
Tomcat 192.168.30.31
192.168.30.32
Mysql 192.168.30.35
事先已经安装完成nginx和mysql
实验达成结果 通过nginx漂移地址访问tomcat搭建的商城项目并登陆，主服务器模拟宕机，实现备份机上线
商城文件 点击链接 提取码: 97f7 里面有商城构架和一个数据库表
以下是各服务详细配置
mysql
[root@localhost ~]# mysql -u root -p #登陆mysql
mysql> create database slsaledb; #创建名为slsaledb 的数据库
mysql> GRANT all ON slsaledb.* TO 'testuser'@'%' IDENTIFIED BY 'admin123'; #授权testuser 使用密码admin123
mysql> flush privileges; #刷新
上传商城数据库文件
[root@localhost ~]# mysql -u root -p <slsaledb-2014-4-10.sql #上传数据表
Enter password: #输入数据管理员库密码
接下来配置tomcat
Tomcat所需文件
[root@lin3031 ~]# tar xf apache-tomcat-8.5.23.tar.gz #解压tomcat
[root@lin3031 ~]# tar xf jdk-8u144-linux-x64.tar.gz #解压java
[root@lin3031 ~]# cp -a jdk1.8.0_144/ /usr/local/java #复制Java解压文件至/usr/local/java
[root@lin3031 ~]# vi /etc/profile #增加环境变量
在最后插入下四行
export JAVA_HOME=/usr/local/java
export JRE_HOME=/usr/local/java/jre
export PATH=$PATH:/usr/local/java/bin
export CLASSPATH=./:/usr/local/java/lib:/usr/local/java/jre/lib
刷新环境变量
[root@lin3031 ~]# source /etc/profile
查看是否生效
[root@lin3031 ~]# java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)
[root@lin3031 ~]# cp -a apache-tomcat-8.5.23 /usr/local/tomcat8 #将解压后的tomcat复制到/usr/local/tomcat8
[root@lin3031 ~]# ln -s /usr/local/tomcat8/bin/startup.sh /usr/bin/tomcatup #优化路径
[root@lin3031 ~]# ln -s /usr/local/tomcat8/bin/shutdown.sh /usr/bin/tomcatdown #优化路径
[root@lin3031 ~]# tomcatup #启动tomcat
[root@lin3031 ~]# netstat -anpt | grep 8080 #过滤8080端口
tcp6 0 0 :::8080 :::* LISTEN 1325/java
另一台tomcat安装操作相同
商城文件 点击链接 提取码: 97f7 里面有商城构架和一个数据库表
需要复制商城文件到tomcat
[root@lin3031 ~]# tar xf SLSaleSystem.tar.gz
[root@lin3031 ~]# cp -a SLSaleSystem /usr/local/tomcat8/webapps/
Tomcat主conf文件中添加 <Context path="" docBase="SLSaleSystem" reloadable="true" debug="0"></Context>
[root@lin3031 ~]# vim /usr/local/tomcat8/conf/server.xml
将tomcat连接后方数据库
[root@lin3031 ~]# vim /usr/local/tomcat8/webapps/SLSaleSystem/WEB-INF/classes/jdbc.properties
修改数据库地址和授权的账号密码
第二台tomcat操作如上相同
下面来测试
启动tomcat
[root@lin3031 ~]# tomcatdown
访问 192.168.30.31:8080 账号 admin 密码 123456
可以看到已经跳出了登陆选项
当然，用户是不可以知晓后方服务器的，需要提供一个前端来访问，下面的操作是配置两个nginx
Nginx配置
第一台 192.168.30.36
[root@lin3036 ~]# vim /usr/local/nginx/conf/nginx.conf
user nginx nginx;
worker_processes 1;
#error_log logs/error.log;
#error_log logs/error.log notice;
error_log logs/error.log info;
#pid logs/nginx.pid;
events {
use epoll;
worker_connections 10240;
}
http {
include mime.types;
default_type application/octet-stream;
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
#access_log logs/access.log main;
sendfile on;
#tcp_nopush on;
#keepalive_timeout 0;
keepalive_timeout 65;
#gzip on;
upstream center_pool { #默认轮询
ip_hash; #保持连接
server 192.168.30.31:8080; #两台tomcat服务器
server 192.168.30.32:8080;
}
server {
listen 80;
server_name lvs01 192.168.30.36;
location / {
proxy_pass http://center_pool; #代理tomcat
}
}
}
使用nginx –t 检查语法
[root@lin3036 ~]# nginx -t
nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok
nginx: [warn] 10240 worker_connections exceed open file resource limit: 1024
nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful
另一台nginx 192.168.30.34
[root@lin3034 ~]# vi /usr/local/nginx/conf/nginx.conf
user nginx nginx;
worker_processes 1;
#error_log logs/error.log;
#error_log logs/error.log notice;
error_log logs/error.log info;
#pid logs/nginx.pid;
events {
use epoll;
worker_connections 10240;
}
http {
include mime.types;
default_type application/octet-stream;
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
#access_log logs/access.log main;
sendfile on;
#tcp_nopush on;
#keepalive_timeout 0;
keepalive_timeout 65;
#gzip on;
upstream center_pool { #默认轮询
ip_hash; #保持连接
server 192.168.30.31:8080; #两台tomcat服务器
server 192.168.30.32:8080;
}
server {
listen 80;
server_name lvs02 192.168.30.34;
location / {
proxy_pass http://center_pool; #代理tomcat
}
}
}
使用nginx –t 检查语法
[root@lin3034 ~]# nginx -t
nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok
nginx: [warn] 10240 worker_connections exceed open file resource limit: 1024
nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful
检查后没有问题就重启nginx
systemctl restart nginx
验证
使用keepalived来保持两台nginx实现热备份 并用192.168.30.100访问商城
下面进行安装
yum -y install popt-devel \
kernel-devel \
openssl-devel
tar xvf keepalived-1.4.2.tar.gz
cd keepalived-1.4.2
[root@lin3034 keepalived-1.4.2]# ./configure --prefix=/
[root@lin3034 keepalived-1.4.2]# make && make install
[root@lin3034 keepalived-1.4.2]# cp keepalived/etc/init.d/keepalived /etc/init.d/
[root@lin3034 keepalived-1.4.2]# systemctl enable keepalived
两台安装方式相同
下面进行配置文件修改
第一台
[root@lin3036 keepalived-1.4.2]# vi /etc/keepalived/keepalived.conf
! Configuration File for keepalived
global_defs {
route_id NGINX-01 #服务器名称
}
vrrp_script nginx {
script "/opt/nginx.sh" #keepalived 状态检查配置文件路径
interval 2
weight -10
}
vrrp_instance VI_1 {
state MASTER #作为主服务器
interface ens33
virtual_router_id 51
priority 150 #优先级设为150
advert_int 1
authentication {
auth_type PASS #认证方式
auth_pass 1111 #认证密码
}
track_script {
nginx
}
virtual_ipaddress {
192.168.30.100 #两台nginx共同虚拟的IP地址（漂移地址）
}
}
该脚本方便同时将nginx和keepalived服务器同时启动
[root@lin3036 keepalived-1.4.2]# vi /opt/nginx.sh
#!/bin/bash
#Filename:nginx.sh
A=$(ps -ef | grep keepalived | grep -v grep | wc -l)
if [ $A -gt 0 ]; then
/etc/init.d/nginx start
else
/etc/init.d/nginx stop
fi
[root@lin3036 keepalived-1.4.2]# chmod +x /opt/nginx.sh
[root@lin3036 keepalived-1.4.2]# systemctl start keepalived
[root@lin3036 keepalived-1.4.2]# ip addr
由于第二台没有配置，所以默认192.168.30.100 在主服务器上
第二台
[root@lin3034 keepalived-1.4.2]# vi /etc/keepalived/keepalived.conf
global_defs {
route_id NGINX-02
}
vrrp_script nginx {
script "/opt/nginx.sh"
interval 2
weight -10
}
vrrp_instance VI_1 {
state BACKUP #作为从服务器
interface ens33
virtual_router_id 51
priority 100 #和主相差50
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
track_script {
nginx
}
virtual_ipaddress {
192.168.30.100
}
根据漂移地址是否存在而启动nginx服务。
[root@lin3034 keepalived-1.4.2]# vi /opt/nginx.sh
#!/bin/bash
#Filename:nginx.sh
A=$(ip addr | grep 192.168.80.100/32 | grep -v grep | wc -l)
if [ $A -gt 0 ]; then
/etc/init.d/nginx start
else
/etc/init.d/nginx stop
fi
chmod +x /opt/nginx.sh
systemctl start keepalived
模拟主服务器故障
[root@lin3036 keepalived-1.4.2]# systemctl stop keepalived
[root@lin3036 keepalived-1.4.2]# systemctl stop nginx
[root@lin3036 keepalived-1.4.2]# ip addr
192.168.30.100 已经不在主服务器上了
而是到了从服务器
[root@lin3034 keepalived-1.4.2]# ip addr
访问192.168.30.100 账号 admin 密码 123456
