Centos7下(双网卡)搭建Nginx+Keepalived高可用
一、背景说明
①、服务器版本信息
OS版本:CentOS Linux release 7.5.1804 (Core)
Keepalived:Keepalived v1.3.5
注:每台服务器两张网卡,一张连内网一张网卡直接连接外网交换机,内网设置静态IP地址,外网网卡不做任何设置!
②、服务器网络信息
Master:10.20.11.180
ens224:内网网卡
ens192:VIP绑定网卡,不用做任何设置!
网络信息如下(keepalived已设置好后的截图):
GENERAL.DEVICE: ens224
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:0C:29:C5:D9:BB
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens224
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/16
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 10.20.11.180/24
IP4.GATEWAY: --
IP4.ROUTE[1]: dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]: 61.139.2.69
IP6.ADDRESS[1]: fe80::8839:e04e:d2f6:5a08/64
IP6.GATEWAY: --
IP6.ROUTE[1]: dst = ff00::/8, nh = ::, mt = 256, table=255
IP6.ROUTE[2]: dst = fe80::/64, nh = ::, mt = 256
IP6.ROUTE[3]: dst = fe80::/64, nh = ::, mt = 100
GENERAL.DEVICE: ens192
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:0C:29:C5:D9:B1
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens192
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/15
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 220.166.180.180/26
IP4.GATEWAY: 220.166.180.129
IP4.ROUTE[1]: dst = 220.166.180.128/26, nh = 0.0.0.0, mt = 0
IP4.ROUTE[2]: dst = 0.0.0.0/0, nh = 220.166.180.129, mt = 0
IP6.GATEWAY: --
Slave:10.20.11.46
ens192:内网网卡
ens160:VIP绑定网卡
[root@nginx-180-slave-46 vhost]# nmcli device show
GENERAL.DEVICE: ens160
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:50:56:9B:AA:70
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens160
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/4398
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 10.20.11.46/24
IP4.GATEWAY: --
IP4.ROUTE[1]: dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]: 61.139.2.69
IP6.ADDRESS[1]: fe80::ae3:b1b9:824a:d8a3/64
IP6.GATEWAY: --
IP6.ROUTE[1]: dst = fe80::/64, nh = ::, mt = 100
IP6.ROUTE[2]: dst = ff00::/8, nh = ::, mt = 256, table=255
GENERAL.DEVICE: ens192
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:50:56:9B:8C:FB
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens192
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/38901
WIRED-PROPERTIES.CARRIER: on
IP4.GATEWAY: --
IP6.GATEWAY: --
GENERAL.DEVICE: lo
GENERAL.TYPE: loopback
GENERAL.HWADDR: 00:00:00:00:00:00
GENERAL.MTU: 65536
GENERAL.STATE: 10 (unmanaged)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
IP4.ADDRESS[1]: 127.0.0.1/8
IP4.GATEWAY: --
IP6.ADDRESS[1]: ::1/128
IP6.GATEWAY: --
VIP:220.166.180.180
注:内网网卡设置网络信息:设置IP地址、子网掩码、DNS地址即可,不用设置网关。外网网卡不用做任何设置。
③、网络架构图如下

④、Nginx、keepalived安装
nginx、keepalived 通过yum进行安装,如果需要二进制安装可以自行百度,本文重点在于配置nginx+keepalived使Nginx可以做到高可用。
二、配置邮件告警通知(已弃用改为钉钉群通知)
2.1、安装邮件服务
[root@server1 ~]# yum -y install mailx sendmail
修改邮件服务配置文件
在配置文件中添加如下参数
[root@server1 ~]# vim /etc/mail.rc
##在配置文件中添加以下参数
set from=*******@qq.com //邮箱账号
set smtp=smtp.qq.com
set smtp-auth-user=*******@qq.com //邮箱账号
set smtp-auth-password=******** //邮箱smtp验证码
set smtp-auth=login
测试邮件发送
[root@localhost keepalived]# mail -s hello *****@qq.com < /etc/centos-release
查看接收邮件:

2.2、编写邮件通知脚本
邮件告警脚本
[root@server1 ~]# vim /etc/keepalived/notify.sh
#!/bin/bash
contact='******@qq.com'
notify() {
mailsubject="$(hostname) to be $1 ,vip转移"
mailbody="$(date +'%F %T'): vrrp trasition, $(hostname) change to be $1"
echo " $mailbody" | mail -s "$mailsubject" $contact
}
case $1 in
master)
notify master
;;
backup)
notify backup
;;
fault)
notify fault
;;
*)
echo "Usage: $(basename $0) {master|backup|fault}"
ecit 1
;;
esac
脚本授权
chmod 755 /etc/keepalived/notify.sh
2.3 DingDing通知脚本(python)
路径:vim /etc/keepalived/nginx_keepalived_notify.py
注:使用python脚本发送通知,两台机器都需要需要安装python requests 模块
pip install requests
access_token改为自己的即可!
#!/usr/local/python
# -*- coding: UTF-8 -*-
import requests
import sys
import json
import socket
import time
def info(jy):
# 钉钉告警
url = 'https://oapi.dingtalk.com/robot/send?access_token=***********'
headers = {
'Content-Type': 'application/json;charset=utf-8'
}
formdata = {
"msgtype": "text",
"text": {"content": str(jy)}
}
# print(formdata)
requests.post(url=url, data=json.dumps(formdata), headers=headers)
def change_status(status):
time1 = time.strftime('%Y-%m-%d %H:%M:%S', time.localtime(time.time()))
hostname = socket.gethostname()
message = "Nginx高可用状态切换告警, " + str(time1) + " vrrp trasition , 主机: " + hostname + " Nginx 状态: change to be " + status
info(message)
if __name__ == '__main__':
status = sys.argv[1]
change_status(status)
三、配置keepalived文件(高可用切换DingDing通知)
注:两台服务器网口名称不一致问题!
Master网口:ens224(内网网口)、ens192(外网网口)。
Backup网口:ens160(内网网口)、ens192:(外网网口)。
3.1 Nginx检测脚本
# vim /etc/keepalived/check_nginx.sh
#!/bin/bash
d=`date --date today +%Y%m%d_%H:%M:%S`
n=`netstat -lntp | grep nginx | wc -l`
if [ $n -eq 0 ]; then
systemctl start nginx
n2=`netstat -lntp | grep nginx | wc -l`
if [ $n2 -eq 0 ]; then
echo "$d nginx down,keepalived will stop" >> /var/log/check_ng.log
systemctl stop keepalived
fi
fi
3.2 防火墙对 keepalived 开放
注:eno16777736为本机监听网口,需要根据服务器监听网口不通而改变。
firewall-cmd --direct --permanent --add-rule ipv4 filter INPUT 0 --in-interface eno16777736 --destination 224.0.0.18 --protocol vrrp -j ACCEPT;
firewall-cmd --reload;
keepalived配置参考:https://www.cnblogs.com/shuiguizi/p/11172267.html
3.3 Master keepalived.conf配置
! Configuration File for keepalived
global_defs {
router_id sjyt_testnginx
}
vrrp_script chk_nginx {
script "/etc/keepalived/check_nginx.sh"
inverval 3
}
vrrp_instance VI_1 {
state MASTER
interface ens224
virtual_router_id 52
priority 100
advert_int 1
authentication {
auth_type PASS
auth_pass kgjaGJOWE398jglkj923KDK
}
virtual_ipaddress {
220.166.180.180/26 dev ens192
}
track_script {
chk_nginx
}
virtual_routes {
default via 220.166.180.129
}
notify_master "/bin/python /etc/keepalived/nginx_keepalived_notify.py master"
notify_backup "/bin/python /etc/keepalived/nginx_keepalived_notify.py backup"
notify_fault "/bin/python /etc/keepalived/nginx_keepalived_notify.py fault"
}
3.4 Slave keepalived.conf配置
! Configuration File for keepalived
global_defs {
router_id sjyt_testnginx
}
vrrp_script chk_nginx {
script "/etc/keepalived/check_nginx.sh"
inverval 3
}
vrrp_instance VI_1 {
state BACKUP
interface ens160
virtual_router_id 52
priority 80
advert_int 1
authentication {
auth_type PASS
auth_pass kgjaGJOWE398jglkj923KDK
}
virtual_ipaddress {
220.166.180.180/26 dev ens192
}
track_script {
chk_nginx
}
virtual_routes {
default via 220.166.180.129
}
notify_master "/bin/python /etc/keepalived/nginx_keepalived_notify.py master"
notify_backup "/bin/python /etc/keepalived/nginx_keepalived_notify.py backup"
notify_fault "/bin/python /etc/keepalived/nginx_keepalived_notify.py fault"
}
四、Nginx+keepalived 高可用验证
①、Master 服务器启动nginx、keepalived服务
[root@nginx-180-master-180 ~]# systemctl status nginx
● nginx.service - nginx service
Loaded: loaded (/etc/systemd/system/nginx.service; enabled; vendor preset: disabled)
Active: active (running) since Mon 2020-09-28 15:50:16 CST; 10 months 0 days ago
Main PID: 19116 (nginx)
CGroup: /system.slice/nginx.service
├─15184 nginx: worker process
├─15185 nginx: worker process
├─15186 nginx: worker process
├─15187 nginx: worker process
├─19116 nginx: master process /usr/local/nginx/sbin/nginx
├─25650 nginx: worker process is shutting down
└─25653 nginx: worker process is shutting down
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
[root@nginx-180-master-180 ~]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
Active: active (running) since Fri 2021-07-30 16:03:02 CST; 27min ago
Process: 4255 ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 4256 (keepalived)
CGroup: /system.slice/keepalived.service
├─4256 /usr/sbin/keepalived -D
├─4257 /usr/sbin/keepalived -D
└─4258 /usr/sbin/keepalived -D
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Opening script file /bin/python
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) Sending/queueing gratuitous ARPs o...180Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Hint: Some lines were ellipsized, use -l to show in full.
查看Master 服务器IP信息:
[root@nginx-180-master-180 ~]# nmcli device show
GENERAL.DEVICE: ens224
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:0C:29:C5:D9:BB
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens224
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/16
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 10.20.11.180/24
IP4.GATEWAY: --
IP4.ROUTE[1]: dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]: 61.139.2.69
IP6.ADDRESS[1]: fe80::8839:e04e:d2f6:5a08/64
IP6.GATEWAY: --
IP6.ROUTE[1]: dst = ff00::/8, nh = ::, mt = 256, table=255
IP6.ROUTE[2]: dst = fe80::/64, nh = ::, mt = 256
IP6.ROUTE[3]: dst = fe80::/64, nh = ::, mt = 100
GENERAL.DEVICE: ens192
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:0C:29:C5:D9:B1
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens192
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/15
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 220.166.180.180/26
IP4.GATEWAY: 220.166.180.129
IP4.ROUTE[1]: dst = 220.166.180.128/26, nh = 0.0.0.0, mt = 0
IP4.ROUTE[2]: dst = 0.0.0.0/0, nh = 220.166.180.129, mt = 0
IP6.GATEWAY: --
GENERAL.DEVICE: lo
GENERAL.TYPE: loopback
GENERAL.HWADDR: 00:00:00:00:00:00
GENERAL.MTU: 65536
GENERAL.STATE: 10 (unmanaged)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
IP4.ADDRESS[1]: 127.0.0.1/8
IP4.GATEWAY: --
IP6.ADDRESS[1]: ::1/128
IP6.GATEWAY: --
②、Slave 服务器启动nginx、keepalived服务
[root@nginx-180-slave-46 vhost]# systemctl status nginx
● nginx.service - nginx service
Loaded: loaded (/etc/systemd/system/nginx.service; enabled; vendor preset: disabled)
Active: active (running) since Fri 2021-07-30 16:34:12 CST; 10s ago
Process: 17073 ExecStop=/usr/local/nginx/sbin/nginx -s quit (code=exited, status=1/FAILURE)
Process: 17241 ExecStart=/usr/local/nginx/sbin/nginx (code=exited, status=0/SUCCESS)
Main PID: 17242 (nginx)
CGroup: /system.slice/nginx.service
├─17242 nginx: master process /usr/local/nginx/sbin/nginx
├─17243 nginx: worker process
├─17244 nginx: worker process
├─17245 nginx: worker process
└─17246 nginx: worker process
Jul 30 16:34:12 nginx-180-slave-46 systemd[1]: Starting nginx service...
Jul 30 16:34:12 nginx-180-slave-46 systemd[1]: Started nginx service.
[root@nginx-180-slave-46 vhost]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
Active: inactive (dead) since Fri 2021-07-30 16:24:16 CST; 10min ago
Process: 9076 ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 9077 (code=exited, status=0/SUCCESS)
CGroup: /system.slice/keepalived.service
└─2288 mail -s nginx-180-slave-46 to be master ,vip 3450597615@qq.com
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: Opening script file /bin/python
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: VRRP sockpool: [ifindex(2), proto(112), unicast(0), fd(10,11)]
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: VRRP_Script(chk_nginx) succeeded
Jul 30 16:24:14 nginx-180-slave-46 systemd[1]: Stopping LVS and VRRP High Availability Monitor...
Jul 30 16:24:14 nginx-180-slave-46 Keepalived[9077]: Stopping
Jul 30 16:24:14 nginx-180-slave-46 Keepalived_healthcheckers[9078]: Stopped
Jul 30 16:24:15 nginx-180-slave-46 Keepalived_vrrp[9079]: Stopped
Jul 30 16:24:15 nginx-180-slave-46 Keepalived[9077]: Stopped Keepalived v1.3.5 (03/19,2017), git commit v1.3.5-6-g6fa32f2
Jul 30 16:24:16 nginx-180-slave-46 systemd[1]: Stopped LVS and VRRP High Availability Monitor.
[root@nginx-180-slave-46 vhost]#
查看salve IP地址信息
[root@nginx-180-slave-46 vhost]# nmcli device show
GENERAL.DEVICE: ens160
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:50:56:9B:AA:70
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens160
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/4398
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 10.20.11.46/24
IP4.GATEWAY: --
IP4.ROUTE[1]: dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]: 61.139.2.69
IP6.ADDRESS[1]: fe80::ae3:b1b9:824a:d8a3/64
IP6.GATEWAY: --
IP6.ROUTE[1]: dst = fe80::/64, nh = ::, mt = 100
IP6.ROUTE[2]: dst = ff00::/8, nh = ::, mt = 256, table=255
GENERAL.DEVICE: ens192
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:50:56:9B:8C:FB
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens192
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/38901
WIRED-PROPERTIES.CARRIER: on
IP4.GATEWAY: --
IP6.GATEWAY: --
GENERAL.DEVICE: lo
GENERAL.TYPE: loopback
GENERAL.HWADDR: 00:00:00:00:00:00
GENERAL.MTU: 65536
GENERAL.STATE: 10 (unmanaged)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
IP4.ADDRESS[1]: 127.0.0.1/8
IP4.GATEWAY: --
IP6.ADDRESS[1]: ::1/128
IP6.GATEWAY: --
③、关闭Master 服务器keepalived,验证是否可以正常切换
Master关闭Keepalived服务
[root@nginx-180-master-180 ~]# systemctl stop keepalived
[root@nginx-180-master-180 ~]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
Active: inactive (dead)
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:36:50 nginx-180-master-180 systemd[1]: Stopping LVS and VRRP High Availability Monitor...
Jul 30 16:36:50 nginx-180-master-180 Keepalived[4256]: Stopping
Jul 30 16:36:50 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) sent 0 priority
Jul 30 16:36:50 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jul 30 16:36:50 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) removing protocol VIPs.
Jul 30 16:36:50 nginx-180-master-180 Keepalived_healthcheckers[4257]: Stopped
Jul 30 16:36:51 nginx-180-master-180 Keepalived_vrrp[4258]: Stopped
Jul 30 16:36:51 nginx-180-master-180 Keepalived[4256]: Stopped Keepalived v1.3.5 (03/19,2017), git commit v1.3.5-...32f2Jul 30 16:36:51 nginx-180-master-180 systemd[1]: Stopped LVS and VRRP High Availability Monitor.
Hint: Some lines were ellipsized, use -l to show in full.
[root@nginx-180-master-180 ~]#
Master IP地址信息
[root@nginx-180-master-180 ~]# nmcli device show
GENERAL.DEVICE: ens224
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:0C:29:C5:D9:BB
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens224
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/16
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 10.20.11.180/24
IP4.GATEWAY: --
IP4.ROUTE[1]: dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]: 61.139.2.69
IP6.ADDRESS[1]: fe80::8839:e04e:d2f6:5a08/64
IP6.GATEWAY: --
IP6.ROUTE[1]: dst = ff00::/8, nh = ::, mt = 256, table=255
IP6.ROUTE[2]: dst = fe80::/64, nh = ::, mt = 256
IP6.ROUTE[3]: dst = fe80::/64, nh = ::, mt = 100
GENERAL.DEVICE: ens192
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:0C:29:C5:D9:B1
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens192
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/15
WIRED-PROPERTIES.CARRIER: on
IP4.GATEWAY: --
IP6.GATEWAY: --
GENERAL.DEVICE: lo
GENERAL.TYPE: loopback
GENERAL.HWADDR: 00:00:00:00:00:00
GENERAL.MTU: 65536
GENERAL.STATE: 10 (unmanaged)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
IP4.ADDRESS[1]: 127.0.0.1/8
IP4.GATEWAY: --
IP6.ADDRESS[1]: ::1/128
IP6.GATEWAY: --
查看Slave服务器keepalived信息
[root@nginx-180-slave-46 vhost]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
Active: active (running) since Fri 2021-07-30 16:37:58 CST; 2min 5s ago
Process: 17272 ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 17273 (keepalived)
CGroup: /system.slice/keepalived.service
├─ 2288 mail -s nginx-180-slave-46 to be master ,vip 3450597615@qq.com
├─17273 /usr/sbin/keepalived -D
├─17274 /usr/sbin/keepalived -D
└─17275 /usr/sbin/keepalived -D
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Opening script file /bin/python
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: VRRP_Instance(VI_1) Sending/queueing gratuitous ARPs o....180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Hint: Some lines were ellipsized, use -l to show in full.
查看IP地址信息:
[root@nginx-180-slave-46 vhost]# nmcli device show
GENERAL.DEVICE: ens160
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:50:56:9B:AA:70
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens160
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/4398
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 10.20.11.46/24
IP4.GATEWAY: --
IP4.ROUTE[1]: dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]: 61.139.2.69
IP6.ADDRESS[1]: fe80::ae3:b1b9:824a:d8a3/64
IP6.GATEWAY: --
IP6.ROUTE[1]: dst = fe80::/64, nh = ::, mt = 100
IP6.ROUTE[2]: dst = ff00::/8, nh = ::, mt = 256, table=255
GENERAL.DEVICE: ens192
GENERAL.TYPE: ethernet
GENERAL.HWADDR: 00:50:56:9B:8C:FB
GENERAL.MTU: 1500
GENERAL.STATE: 100 (connected)
GENERAL.CONNECTION: ens192
GENERAL.CON-PATH: /org/freedesktop/NetworkManager/ActiveConnection/38901
WIRED-PROPERTIES.CARRIER: on
IP4.ADDRESS[1]: 220.166.180.180/26
IP4.GATEWAY: 220.166.180.129
IP4.ROUTE[1]: dst = 220.166.180.128/26, nh = 0.0.0.0, mt = 0
IP4.ROUTE[2]: dst = 0.0.0.0/0, nh = 220.166.180.129, mt = 0
IP6.GATEWAY: --
GENERAL.DEVICE: lo
GENERAL.TYPE: loopback
GENERAL.HWADDR: 00:00:00:00:00:00
GENERAL.MTU: 65536
GENERAL.STATE: 10 (unmanaged)
GENERAL.CONNECTION: --
GENERAL.CON-PATH: --
IP4.ADDRESS[1]: 127.0.0.1/8
IP4.GATEWAY: --
IP6.ADDRESS[1]: ::1/128
IP6.GATEWAY: --
重新启动Master keepalived 服务
钉钉通知:

五、报错处理
报错一、
notify_master或者notify_backup不执行脚本
原因一、selinux 未关闭。
[root@nginx-180-slave-46 vhost]# getenforce
Permissive
解决办法:
切换时,脚本始终不执行,过google了半天,发现有一个这样写到:
原文链接:https://serverfault.com/questions/709428/track-script-doesnt-work-after-keepalived-update
chcon -t keepalived_unconfined_script_exec_t /etc/keepalived/chk_available.sh
我的是这样执行:(主keepalived和备keepalived都执行)
chcon -t keepalived_unconfined_script_exec_t /d/d_ctl.sh
再重启keepalived测试,完全解决
报错二、
集群脑裂,master 是master,backup也变成了master
原因分析:
VRRP控制报文只有一种:VRRP通告(advertisement)。它使用IP多播数据包进行封装,组地址为224.0.0.18,发布范围只限于同一局域网内。这保证了VRID在不同网络中可以重复使用。为了减少网络带宽消耗只有主控路由器才可以周期性的发送VRRP通告报文。备份路由器在连续三个通告间隔内收不到VRRP或收到优先级为0的通告后启动新的一轮VRRP选举。
------------以下转载别人的博客
centos7安装keepalived后,不关闭防火墙,虚拟ip不能实现漂移,双机都为master,不能实现双机热备的效果。原因是防火墙中没有方形vrrp的组播 IP 244.0.0.18。centos7下使用的防火请是firewall,本人不会使用centos7默认的防火墙放行组播IP,所以禁用掉centos7默认的防火墙,使用iptables防火墙。
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: Truncating auth_pass to 8 characters
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) removing protocol VIPs.
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: Using LinkWatch kernel netlink reflector...
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) Entering BACKUP STATE
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP sockpool: [ifindex(3), proto(112), unicast(0), fd(10,11)]
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Script(chk_nginx) succeeded
Jun 16 11:36:37 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) Transition to MASTER STATE
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) Entering MASTER STATE
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) setting protocol VIPs.
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) setting protocol Virtual Routes
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: Sending gratuitous ARP on ens192 for 192.168.6.10
解决办法:
防火墙放行检测端口
firewall-cmd --direct --permanent --add-rule ipv4 filter INPUT 0 --in-interface eno16777736 --destination 224.0.0.18 --protocol vrrp -j ACCEPT;
firewall-cmd --reload;
本文详细介绍了在Centos7环境下,如何利用双网卡搭建Nginx+Keepalived实现高可用。通过配置Nginx和Keepalived,结合DingDing通知,确保服务的稳定性和故障切换。同时,文章还涵盖了报错处理和网络架构等关键点。
搭建Nginx+Keepalived高可用&spm=1001.2101.3001.5002&articleId=117819760&d=1&t=3&u=e0a7c020e76d482cace2ba4bf0763b71)
3345

被折叠的 条评论
为什么被折叠?



