Centos7下(双网卡)搭建Nginx+Keepalived高可用

本文详细介绍了在Centos7环境下,如何利用双网卡搭建Nginx+Keepalived实现高可用。通过配置Nginx和Keepalived,结合DingDing通知,确保服务的稳定性和故障切换。同时,文章还涵盖了报错处理和网络架构等关键点。

Centos7下(双网卡)搭建Nginx+Keepalived高可用

 一、背景说明

①、服务器版本信息

OS版本:CentOS Linux release 7.5.1804 (Core) 

Keepalived:Keepalived v1.3.5

注:每台服务器两张网卡,一张连内网一张网卡直接连接外网交换机,内网设置静态IP地址,外网网卡不做任何设置!

②、服务器网络信息

Master:10.20.11.180

ens224:内网网卡

ens192:VIP绑定网卡,不用做任何设置!

网络信息如下(keepalived已设置好后的截图):

GENERAL.DEVICE:                         ens224
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:0C:29:C5:D9:BB
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens224
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/16
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         10.20.11.180/24
IP4.GATEWAY:                            --
IP4.ROUTE[1]:                           dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]:                             61.139.2.69
IP6.ADDRESS[1]:                         fe80::8839:e04e:d2f6:5a08/64
IP6.GATEWAY:                            --
IP6.ROUTE[1]:                           dst = ff00::/8, nh = ::, mt = 256, table=255
IP6.ROUTE[2]:                           dst = fe80::/64, nh = ::, mt = 256
IP6.ROUTE[3]:                           dst = fe80::/64, nh = ::, mt = 100

GENERAL.DEVICE:                         ens192
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:0C:29:C5:D9:B1
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens192
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/15
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         220.166.180.180/26
IP4.GATEWAY:                            220.166.180.129
IP4.ROUTE[1]:                           dst = 220.166.180.128/26, nh = 0.0.0.0, mt = 0
IP4.ROUTE[2]:                           dst = 0.0.0.0/0, nh = 220.166.180.129, mt = 0
IP6.GATEWAY:                            --

Slave:10.20.11.46

ens192:内网网卡

ens160:VIP绑定网卡

[root@nginx-180-slave-46 vhost]# nmcli device show
GENERAL.DEVICE:                         ens160
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:50:56:9B:AA:70
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens160
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/4398
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         10.20.11.46/24
IP4.GATEWAY:                            --
IP4.ROUTE[1]:                           dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]:                             61.139.2.69
IP6.ADDRESS[1]:                         fe80::ae3:b1b9:824a:d8a3/64
IP6.GATEWAY:                            --
IP6.ROUTE[1]:                           dst = fe80::/64, nh = ::, mt = 100
IP6.ROUTE[2]:                           dst = ff00::/8, nh = ::, mt = 256, table=255

GENERAL.DEVICE:                         ens192
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:50:56:9B:8C:FB
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens192
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/38901
WIRED-PROPERTIES.CARRIER:               on
IP4.GATEWAY:                            --
IP6.GATEWAY:                            --

GENERAL.DEVICE:                         lo
GENERAL.TYPE:                           loopback
GENERAL.HWADDR:                         00:00:00:00:00:00
GENERAL.MTU:                            65536
GENERAL.STATE:                          10 (unmanaged)
GENERAL.CONNECTION:                     --
GENERAL.CON-PATH:                       --
IP4.ADDRESS[1]:                         127.0.0.1/8
IP4.GATEWAY:                            --
IP6.ADDRESS[1]:                         ::1/128
IP6.GATEWAY:                            --

VIP:220.166.180.180

注:内网网卡设置网络信息:设置IP地址、子网掩码、DNS地址即可,不用设置网关。外网网卡不用做任何设置。

③、网络架构图如下

 ④、Nginx、keepalived安装

nginx、keepalived 通过yum进行安装,如果需要二进制安装可以自行百度,本文重点在于配置nginx+keepalived使Nginx可以做到高可用。

二、配置邮件告警通知(已弃用改为钉钉群通知

2.1、安装邮件服务

[root@server1 ~]# yum -y install mailx sendmail

修改邮件服务配置文件

在配置文件中添加如下参数

[root@server1 ~]# vim /etc/mail.rc 
##在配置文件中添加以下参数
set from=*******@qq.com  //邮箱账号
set smtp=smtp.qq.com
set smtp-auth-user=*******@qq.com     //邮箱账号
set smtp-auth-password=********   //邮箱smtp验证码
set smtp-auth=login

测试邮件发送

[root@localhost keepalived]# mail -s hello *****@qq.com < /etc/centos-release

查看接收邮件:

2.2、编写邮件通知脚本

邮件告警脚本

[root@server1 ~]# vim  /etc/keepalived/notify.sh 
#!/bin/bash
contact='******@qq.com'
notify() {
	mailsubject="$(hostname) to be $1 ,vip转移"
	mailbody="$(date +'%F %T'): vrrp trasition, $(hostname) change to be $1"
	echo " $mailbody" | mail -s "$mailsubject" $contact
}
case $1 in
master)
	notify master
	;;
backup)
	notify backup
	;;
fault)
	notify fault
	;;
*)
	echo "Usage: $(basename $0) {master|backup|fault}"
	ecit 1
	;;
esac

脚本授权

chmod 755 /etc/keepalived/notify.sh

2.3 DingDing通知脚本(python)

路径:vim /etc/keepalived/nginx_keepalived_notify.py

注:使用python脚本发送通知,两台机器都需要需要安装python requests 模块

pip install requests

access_token改为自己的即可!


#!/usr/local/python
# -*- coding: UTF-8 -*-
import requests
import sys
import json
import socket
import time


def info(jy):
    # 钉钉告警
    url = 'https://oapi.dingtalk.com/robot/send?access_token=***********'

    headers = {
        'Content-Type': 'application/json;charset=utf-8'
    }
    formdata = {
        "msgtype": "text",
        "text": {"content": str(jy)}
    }
    # print(formdata)
    requests.post(url=url, data=json.dumps(formdata), headers=headers)


def change_status(status):
    time1 = time.strftime('%Y-%m-%d %H:%M:%S', time.localtime(time.time()))
    hostname = socket.gethostname()
    message = "Nginx高可用状态切换告警, " + str(time1) + " vrrp trasition , 主机: " + hostname + " Nginx 状态: change to be " + status
    info(message)


if __name__ == '__main__':
    status = sys.argv[1]
    change_status(status)

三、配置keepalived文件(高可用切换DingDing通知

注:两台服务器网口名称不一致问题!

Master网口:ens224(内网网口)、ens192(外网网口)。

Backup网口:ens160(内网网口)、ens192:(外网网口)。

3.1 Nginx检测脚本

# vim /etc/keepalived/check_nginx.sh 

#!/bin/bash

d=`date --date today +%Y%m%d_%H:%M:%S`
n=`netstat -lntp | grep nginx | wc -l`

if [ $n -eq 0 ]; then
	systemctl start nginx
	n2=`netstat -lntp | grep nginx | wc -l`
	if [ $n2 -eq 0 ]; then
		echo "$d nginx down,keepalived will stop" >> /var/log/check_ng.log
		systemctl stop keepalived
	fi
fi

3.2 防火墙对 keepalived 开放

注:eno16777736为本机监听网口,需要根据服务器监听网口不通而改变。

firewall-cmd --direct --permanent --add-rule ipv4 filter INPUT 0 --in-interface eno16777736 --destination 224.0.0.18 --protocol vrrp -j ACCEPT;
firewall-cmd --reload;

keepalived配置参考:https://www.cnblogs.com/shuiguizi/p/11172267.html

3.3 Master keepalived.conf配置

! Configuration File for keepalived
global_defs {
   router_id sjyt_testnginx
}

vrrp_script chk_nginx {
        script "/etc/keepalived/check_nginx.sh"
        inverval 3
}

vrrp_instance VI_1 {
    state MASTER
    interface ens224
    virtual_router_id 52
    priority 100
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass kgjaGJOWE398jglkj923KDK
    }
    virtual_ipaddress {
        220.166.180.180/26 dev ens192
    }

    track_script {
        chk_nginx
    }
    virtual_routes {
        default via 220.166.180.129
    }
    notify_master "/bin/python /etc/keepalived/nginx_keepalived_notify.py master"
    notify_backup "/bin/python /etc/keepalived/nginx_keepalived_notify.py backup"
    notify_fault "/bin/python /etc/keepalived/nginx_keepalived_notify.py fault"
}

3.4 Slave keepalived.conf配置

! Configuration File for keepalived
global_defs {
   router_id sjyt_testnginx
}

vrrp_script chk_nginx {
        script "/etc/keepalived/check_nginx.sh"
        inverval 3
}
vrrp_instance VI_1 {
    state BACKUP
    interface ens160
    virtual_router_id 52
    priority 80
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass kgjaGJOWE398jglkj923KDK
    }
    virtual_ipaddress {
        220.166.180.180/26 dev ens192
    }

    track_script {
        chk_nginx
    }
    virtual_routes {
        default via 220.166.180.129
    }
    notify_master "/bin/python /etc/keepalived/nginx_keepalived_notify.py master"
    notify_backup "/bin/python /etc/keepalived/nginx_keepalived_notify.py backup"
    notify_fault "/bin/python /etc/keepalived/nginx_keepalived_notify.py fault"
}

四、Nginx+keepalived 高可用验证

①、Master 服务器启动nginx、keepalived服务

[root@nginx-180-master-180 ~]# systemctl status nginx
● nginx.service - nginx service
   Loaded: loaded (/etc/systemd/system/nginx.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2020-09-28 15:50:16 CST; 10 months 0 days ago
 Main PID: 19116 (nginx)
   CGroup: /system.slice/nginx.service
           ├─15184 nginx: worker process
           ├─15185 nginx: worker process
           ├─15186 nginx: worker process
           ├─15187 nginx: worker process
           ├─19116 nginx: master process /usr/local/nginx/sbin/nginx
           ├─25650 nginx: worker process is shutting down
           └─25653 nginx: worker process is shutting down

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
[root@nginx-180-master-180 ~]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
   Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
   Active: active (running) since Fri 2021-07-30 16:03:02 CST; 27min ago
  Process: 4255 ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 4256 (keepalived)
   CGroup: /system.slice/keepalived.service
           ├─4256 /usr/sbin/keepalived -D
           ├─4257 /usr/sbin/keepalived -D
           └─4258 /usr/sbin/keepalived -D

Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:04 nginx-180-master-180 Keepalived_vrrp[4258]: Opening script file /bin/python
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) Sending/queueing gratuitous ARPs o...180Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Hint: Some lines were ellipsized, use -l to show in full.

查看Master 服务器IP信息:

[root@nginx-180-master-180 ~]# nmcli device show
GENERAL.DEVICE:                         ens224
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:0C:29:C5:D9:BB
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens224
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/16
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         10.20.11.180/24
IP4.GATEWAY:                            --
IP4.ROUTE[1]:                           dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]:                             61.139.2.69
IP6.ADDRESS[1]:                         fe80::8839:e04e:d2f6:5a08/64
IP6.GATEWAY:                            --
IP6.ROUTE[1]:                           dst = ff00::/8, nh = ::, mt = 256, table=255
IP6.ROUTE[2]:                           dst = fe80::/64, nh = ::, mt = 256
IP6.ROUTE[3]:                           dst = fe80::/64, nh = ::, mt = 100

GENERAL.DEVICE:                         ens192
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:0C:29:C5:D9:B1
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens192
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/15
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         220.166.180.180/26
IP4.GATEWAY:                            220.166.180.129
IP4.ROUTE[1]:                           dst = 220.166.180.128/26, nh = 0.0.0.0, mt = 0
IP4.ROUTE[2]:                           dst = 0.0.0.0/0, nh = 220.166.180.129, mt = 0
IP6.GATEWAY:                            --

GENERAL.DEVICE:                         lo
GENERAL.TYPE:                           loopback
GENERAL.HWADDR:                         00:00:00:00:00:00
GENERAL.MTU:                            65536
GENERAL.STATE:                          10 (unmanaged)
GENERAL.CONNECTION:                     --
GENERAL.CON-PATH:                       --
IP4.ADDRESS[1]:                         127.0.0.1/8
IP4.GATEWAY:                            --
IP6.ADDRESS[1]:                         ::1/128
IP6.GATEWAY:                            --

②、Slave 服务器启动nginx、keepalived服务

[root@nginx-180-slave-46 vhost]# systemctl status nginx
● nginx.service - nginx service
   Loaded: loaded (/etc/systemd/system/nginx.service; enabled; vendor preset: disabled)
   Active: active (running) since Fri 2021-07-30 16:34:12 CST; 10s ago
  Process: 17073 ExecStop=/usr/local/nginx/sbin/nginx -s quit (code=exited, status=1/FAILURE)
  Process: 17241 ExecStart=/usr/local/nginx/sbin/nginx (code=exited, status=0/SUCCESS)
 Main PID: 17242 (nginx)
   CGroup: /system.slice/nginx.service
           ├─17242 nginx: master process /usr/local/nginx/sbin/nginx
           ├─17243 nginx: worker process
           ├─17244 nginx: worker process
           ├─17245 nginx: worker process
           └─17246 nginx: worker process

Jul 30 16:34:12 nginx-180-slave-46 systemd[1]: Starting nginx service...
Jul 30 16:34:12 nginx-180-slave-46 systemd[1]: Started nginx service.
[root@nginx-180-slave-46 vhost]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
   Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
   Active: inactive (dead) since Fri 2021-07-30 16:24:16 CST; 10min ago
  Process: 9076 ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 9077 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/keepalived.service
           └─2288 mail -s nginx-180-slave-46 to be master ,vip 3450597615@qq.com

Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: Opening script file /bin/python
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: VRRP sockpool: [ifindex(2), proto(112), unicast(0), fd(10,11)]
Jul 30 16:05:46 nginx-180-slave-46 Keepalived_vrrp[9079]: VRRP_Script(chk_nginx) succeeded
Jul 30 16:24:14 nginx-180-slave-46 systemd[1]: Stopping LVS and VRRP High Availability Monitor...
Jul 30 16:24:14 nginx-180-slave-46 Keepalived[9077]: Stopping
Jul 30 16:24:14 nginx-180-slave-46 Keepalived_healthcheckers[9078]: Stopped
Jul 30 16:24:15 nginx-180-slave-46 Keepalived_vrrp[9079]: Stopped
Jul 30 16:24:15 nginx-180-slave-46 Keepalived[9077]: Stopped Keepalived v1.3.5 (03/19,2017), git commit v1.3.5-6-g6fa32f2
Jul 30 16:24:16 nginx-180-slave-46 systemd[1]: Stopped LVS and VRRP High Availability Monitor.
[root@nginx-180-slave-46 vhost]#

查看salve IP地址信息

[root@nginx-180-slave-46 vhost]# nmcli device show
GENERAL.DEVICE:                         ens160
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:50:56:9B:AA:70
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens160
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/4398
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         10.20.11.46/24
IP4.GATEWAY:                            --
IP4.ROUTE[1]:                           dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]:                             61.139.2.69
IP6.ADDRESS[1]:                         fe80::ae3:b1b9:824a:d8a3/64
IP6.GATEWAY:                            --
IP6.ROUTE[1]:                           dst = fe80::/64, nh = ::, mt = 100
IP6.ROUTE[2]:                           dst = ff00::/8, nh = ::, mt = 256, table=255

GENERAL.DEVICE:                         ens192
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:50:56:9B:8C:FB
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens192
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/38901
WIRED-PROPERTIES.CARRIER:               on
IP4.GATEWAY:                            --
IP6.GATEWAY:                            --

GENERAL.DEVICE:                         lo
GENERAL.TYPE:                           loopback
GENERAL.HWADDR:                         00:00:00:00:00:00
GENERAL.MTU:                            65536
GENERAL.STATE:                          10 (unmanaged)
GENERAL.CONNECTION:                     --
GENERAL.CON-PATH:                       --
IP4.ADDRESS[1]:                         127.0.0.1/8
IP4.GATEWAY:                            --
IP6.ADDRESS[1]:                         ::1/128
IP6.GATEWAY:                            --

③、关闭Master 服务器keepalived,验证是否可以正常切换

Master关闭Keepalived服务

[root@nginx-180-master-180 ~]# systemctl stop keepalived
[root@nginx-180-master-180 ~]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
   Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
   Active: inactive (dead)

Jul 30 16:03:09 nginx-180-master-180 Keepalived_vrrp[4258]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:36:50 nginx-180-master-180 systemd[1]: Stopping LVS and VRRP High Availability Monitor...
Jul 30 16:36:50 nginx-180-master-180 Keepalived[4256]: Stopping
Jul 30 16:36:50 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) sent 0 priority
Jul 30 16:36:50 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jul 30 16:36:50 nginx-180-master-180 Keepalived_vrrp[4258]: VRRP_Instance(VI_1) removing protocol VIPs.
Jul 30 16:36:50 nginx-180-master-180 Keepalived_healthcheckers[4257]: Stopped
Jul 30 16:36:51 nginx-180-master-180 Keepalived_vrrp[4258]: Stopped
Jul 30 16:36:51 nginx-180-master-180 Keepalived[4256]: Stopped Keepalived v1.3.5 (03/19,2017), git commit v1.3.5-...32f2Jul 30 16:36:51 nginx-180-master-180 systemd[1]: Stopped LVS and VRRP High Availability Monitor.
Hint: Some lines were ellipsized, use -l to show in full.
[root@nginx-180-master-180 ~]#  

Master IP地址信息

[root@nginx-180-master-180 ~]# nmcli device show
GENERAL.DEVICE:                         ens224
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:0C:29:C5:D9:BB
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens224
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/16
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         10.20.11.180/24
IP4.GATEWAY:                            --
IP4.ROUTE[1]:                           dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]:                             61.139.2.69
IP6.ADDRESS[1]:                         fe80::8839:e04e:d2f6:5a08/64
IP6.GATEWAY:                            --
IP6.ROUTE[1]:                           dst = ff00::/8, nh = ::, mt = 256, table=255
IP6.ROUTE[2]:                           dst = fe80::/64, nh = ::, mt = 256
IP6.ROUTE[3]:                           dst = fe80::/64, nh = ::, mt = 100

GENERAL.DEVICE:                         ens192
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:0C:29:C5:D9:B1
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens192
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/15
WIRED-PROPERTIES.CARRIER:               on
IP4.GATEWAY:                            --
IP6.GATEWAY:                            --

GENERAL.DEVICE:                         lo
GENERAL.TYPE:                           loopback
GENERAL.HWADDR:                         00:00:00:00:00:00
GENERAL.MTU:                            65536
GENERAL.STATE:                          10 (unmanaged)
GENERAL.CONNECTION:                     --
GENERAL.CON-PATH:                       --
IP4.ADDRESS[1]:                         127.0.0.1/8
IP4.GATEWAY:                            --
IP6.ADDRESS[1]:                         ::1/128
IP6.GATEWAY:                            --

查看Slave服务器keepalived信息

[root@nginx-180-slave-46 vhost]# systemctl status keepalived
● keepalived.service - LVS and VRRP High Availability Monitor
   Loaded: loaded (/usr/lib/systemd/system/keepalived.service; disabled; vendor preset: disabled)
   Active: active (running) since Fri 2021-07-30 16:37:58 CST; 2min 5s ago
  Process: 17272 ExecStart=/usr/sbin/keepalived $KEEPALIVED_OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 17273 (keepalived)
   CGroup: /system.slice/keepalived.service
           ├─ 2288 mail -s nginx-180-slave-46 to be master ,vip 3450597615@qq.com
           ├─17273 /usr/sbin/keepalived -D
           ├─17274 /usr/sbin/keepalived -D
           └─17275 /usr/sbin/keepalived -D

Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:03 nginx-180-slave-46 Keepalived_vrrp[17275]: Opening script file /bin/python
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: VRRP_Instance(VI_1) Sending/queueing gratuitous ARPs o....180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Jul 30 16:38:08 nginx-180-slave-46 Keepalived_vrrp[17275]: Sending gratuitous ARP on ens192 for 220.166.180.180
Hint: Some lines were ellipsized, use -l to show in full.

查看IP地址信息:

[root@nginx-180-slave-46 vhost]# nmcli device show
GENERAL.DEVICE:                         ens160
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:50:56:9B:AA:70
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens160
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/4398
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         10.20.11.46/24
IP4.GATEWAY:                            --
IP4.ROUTE[1]:                           dst = 10.20.11.0/24, nh = 0.0.0.0, mt = 100
IP4.DNS[1]:                             61.139.2.69
IP6.ADDRESS[1]:                         fe80::ae3:b1b9:824a:d8a3/64
IP6.GATEWAY:                            --
IP6.ROUTE[1]:                           dst = fe80::/64, nh = ::, mt = 100
IP6.ROUTE[2]:                           dst = ff00::/8, nh = ::, mt = 256, table=255

GENERAL.DEVICE:                         ens192
GENERAL.TYPE:                           ethernet
GENERAL.HWADDR:                         00:50:56:9B:8C:FB
GENERAL.MTU:                            1500
GENERAL.STATE:                          100 (connected)
GENERAL.CONNECTION:                     ens192
GENERAL.CON-PATH:                       /org/freedesktop/NetworkManager/ActiveConnection/38901
WIRED-PROPERTIES.CARRIER:               on
IP4.ADDRESS[1]:                         220.166.180.180/26
IP4.GATEWAY:                            220.166.180.129
IP4.ROUTE[1]:                           dst = 220.166.180.128/26, nh = 0.0.0.0, mt = 0
IP4.ROUTE[2]:                           dst = 0.0.0.0/0, nh = 220.166.180.129, mt = 0
IP6.GATEWAY:                            --

GENERAL.DEVICE:                         lo
GENERAL.TYPE:                           loopback
GENERAL.HWADDR:                         00:00:00:00:00:00
GENERAL.MTU:                            65536
GENERAL.STATE:                          10 (unmanaged)
GENERAL.CONNECTION:                     --
GENERAL.CON-PATH:                       --
IP4.ADDRESS[1]:                         127.0.0.1/8
IP4.GATEWAY:                            --
IP6.ADDRESS[1]:                         ::1/128
IP6.GATEWAY:                            --

重新启动Master keepalived 服务

钉钉通知:

五、报错处理 

报错一、

notify_master或者notify_backup不执行脚本

原因一、selinux 未关闭。

[root@nginx-180-slave-46 vhost]# getenforce
Permissive

解决办法:

切换时,脚本始终不执行,过google了半天,发现有一个这样写到:

原文链接:https://serverfault.com/questions/709428/track-script-doesnt-work-after-keepalived-update

chcon -t keepalived_unconfined_script_exec_t /etc/keepalived/chk_available.sh
我的是这样执行:(主keepalived和备keepalived都执行)

chcon -t keepalived_unconfined_script_exec_t  /d/d_ctl.sh

再重启keepalived测试,完全解决

报错二、

集群脑裂,master 是master,backup也变成了master

原因分析:

VRRP控制报文只有一种:VRRP通告(advertisement)。它使用IP多播数据包进行封装,组地址为224.0.0.18,发布范围只限于同一局域网内。这保证了VRID在不同网络中可以重复使用。为了减少网络带宽消耗只有主控路由器才可以周期性的发送VRRP通告报文。备份路由器在连续三个通告间隔内收不到VRRP或收到优先级为0的通告后启动新的一轮VRRP选举。

------------以下转载别人的博客

  centos7安装keepalived后,不关闭防火墙,虚拟ip不能实现漂移,双机都为master,不能实现双机热备的效果。原因是防火墙中没有方形vrrp的组播 IP 244.0.0.18。centos7下使用的防火请是firewall,本人不会使用centos7默认的防火墙放行组播IP,所以禁用掉centos7默认的防火墙,使用iptables防火墙。

Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: Truncating auth_pass to 8 characters
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) removing protocol VIPs.
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: Using LinkWatch kernel netlink reflector...
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) Entering BACKUP STATE
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) removing protocol Virtual Routes
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP sockpool: [ifindex(3), proto(112), unicast(0), fd(10,11)]
Jun 16 11:36:33 localhost Keepalived_vrrp[12303]: VRRP_Script(chk_nginx) succeeded
Jun 16 11:36:37 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) Transition to MASTER STATE
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) Entering MASTER STATE
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) setting protocol VIPs.
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: VRRP_Instance(VI_1) setting protocol Virtual Routes
Jun 16 11:36:38 localhost Keepalived_vrrp[12303]: Sending gratuitous ARP on ens192 for 192.168.6.10

解决办法:

防火墙放行检测端口

firewall-cmd --direct --permanent --add-rule ipv4 filter INPUT 0 --in-interface eno16777736 --destination 224.0.0.18 --protocol vrrp -j ACCEPT;
firewall-cmd --reload;

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值